[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:16 dist-test-slave-2w3w krb5kdc[11746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:16 dist-test-slave-2w3w krb5kdc[11746](info): set up 2 sockets
Aug 12 09:50:16 dist-test-slave-2w3w krb5kdc[11746](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 09:50:17.410882 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.007s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:17 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:17.560125 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45287
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:17.699029 11762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:17.699345 11762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:17.699393 11762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:17.703574 11762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:17.703641 11762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:17.703661 11762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:17.703679 11762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:17.703694 11762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:17.710037 11762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:17.711683 11762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:17.713078 11762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:17.726802 11769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:17.727217 11762 server_base.cc:1034] running on GCE node
W20260812 09:50:17.727540 11768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:17.727753 11771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:17.728674 11762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:17.730640 11762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:17.731868 11762 hybrid_clock.cc:648] HybridClock initialized: now 1786528217731827 us; error 57 us; skew 500 ppm
Aug 12 09:50:17 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528217, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:17.735661 11762 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:17.737116 11762 webserver.cc:460] Webserver started at http://127.11.118.190:46055/ using document root <none> and password file <none>
I20260812 09:50:17.738054 11762 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:17.738131 11762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:17.738499 11762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:17.741640 11762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "30c59bd1e2fe471992ef5350c0431366"
format_stamp: "Formatted at 2026-08-12 09:50:17 on dist-test-slave-2w3w"
server_key: "b0cbbbdf0c2eaa659cf60e2501dee8d8"
server_key_iv: "9199b38002fb6f844c05a0cfd72a272c"
server_key_version: "encryptionkey@0"
I20260812 09:50:17.742688 11762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "30c59bd1e2fe471992ef5350c0431366"
format_stamp: "Formatted at 2026-08-12 09:50:17 on dist-test-slave-2w3w"
server_key: "b0cbbbdf0c2eaa659cf60e2501dee8d8"
server_key_iv: "9199b38002fb6f844c05a0cfd72a272c"
server_key_version: "encryptionkey@0"
I20260812 09:50:17.748581 11762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 09:50:17.752663 11779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:17.754596 11762 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:17.754853 11762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "30c59bd1e2fe471992ef5350c0431366"
format_stamp: "Formatted at 2026-08-12 09:50:17 on dist-test-slave-2w3w"
server_key: "b0cbbbdf0c2eaa659cf60e2501dee8d8"
server_key_iv: "9199b38002fb6f844c05a0cfd72a272c"
server_key_version: "encryptionkey@0"
I20260812 09:50:17.755084 11762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:17.776701 11762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:17.781015 11762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:17.781373 11762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:17.798924 11762 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:45287
I20260812 09:50:17.799201 11843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:45287 every 8 connection(s)
I20260812 09:50:17.800611 11762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:17.805667 11845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:17.811028 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 11762
I20260812 09:50:17.811280 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:17.814075 11738 external_mini_cluster.cc:1428] Setting key 9ae191f52604804fb6dc240f2bf4c2f2
I20260812 09:50:17.819950 11845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366: Bootstrap starting.
I20260812 09:50:17.825609 11845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:17.827677 11845 log.cc:824] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:17.831655 11845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366: No bootstrap required, opened a new log
I20260812 09:50:17.839818 11845 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } }
I20260812 09:50:17.840296 11845 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:17.840384 11845 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30c59bd1e2fe471992ef5350c0431366, State: Initialized, Role: FOLLOWER
I20260812 09:50:17.841361 11845 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } }
I20260812 09:50:17.841635 11845 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:17.841809 11845 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:17.841964 11845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:17.843297 11845 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } }
I20260812 09:50:17.843894 11845 leader_election.cc:302] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30c59bd1e2fe471992ef5350c0431366; no voters:
I20260812 09:50:17.844348 11845 leader_election.cc:288] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:17.844584 11851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:17.845153 11851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [term 1 LEADER]: Becoming Leader. State: Replica: 30c59bd1e2fe471992ef5350c0431366, State: Running, Role: LEADER
I20260812 09:50:17.846225 11851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } }
Aug 12 09:50:17 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:17.846912 11845 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:17.849851 11852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30c59bd1e2fe471992ef5350c0431366" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } } }
I20260812 09:50:17.849821 11853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30c59bd1e2fe471992ef5350c0431366. Latest consensus state: current_term: 1 leader_uuid: "30c59bd1e2fe471992ef5350c0431366" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30c59bd1e2fe471992ef5350c0431366" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45287 } } }
I20260812 09:50:17.850035 11852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:17.850035 11853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:17.852525 11861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:17.860363 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:17.821177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.11.118.190:45287)
0812 09:50:17.822014 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:17.822065 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:17.826265 (+ 4200us) server_negotiation.cc:407] Connection header received
0812 09:50:17.831922 (+ 5657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:17.831949 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:17.832696 (+ 747us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:17.833229 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:17.836350 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:17.838376 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:17.840116 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:17.840971 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:17.841210 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:17.848501 (+ 7291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:17.848553 (+ 52us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:17.848574 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:17.848620 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:17.852047 (+ 3427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:17.853270 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:17.853279 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:17.853285 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:17.853533 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:17.854232 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:17.854239 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:17.854244 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:17.855232 (+ 988us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:17.856395 (+ 1163us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:17.858217 (+ 1822us) server_negotiation.cc:299] Negotiation successful
0812 09:50:17.858649 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":205,"threads_started":1}
I20260812 09:50:17.860526 11861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:17.870788 11861 catalog_manager.cc:1347] Generated new cluster ID: 03adc496e39a475b8a46d7cd9d45faf2
I20260812 09:50:17.870885 11861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:17.881633 11861 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:17.883500 11861 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:17.892992 11861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30c59bd1e2fe471992ef5350c0431366: Generated new TSK 0
I20260812 09:50:17.894004 11861 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:17.940130 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:18.098784 11874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:18.099108 11874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:18.099161 11874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:18.103592 11874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:18.103665 11874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:18.103770 11874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:18.109550 11874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:18.110783 11874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:18.111867 11874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:18.123155 11880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.123217 11882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.123229 11879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:18.123580 11874 server_base.cc:1034] running on GCE node
I20260812 09:50:18.124037 11874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:18.124707 11874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:18.125902 11874 hybrid_clock.cc:648] HybridClock initialized: now 1786528218125866 us; error 52 us; skew 500 ppm
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:18.129539 11874 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:18.130424 11874 webserver.cc:460] Webserver started at http://127.11.118.129:42009/ using document root <none> and password file <none>
I20260812 09:50:18.130954 11874 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:18.131085 11874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:18.131265 11874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:18.133446 11874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "30f06539559b4d7c82eaf3b50d725892"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "37eaf520f784b85394b4050fecff40e4"
server_key_iv: "b3f2e12027e1cda687a70360b0f3b398"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.134012 11874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "30f06539559b4d7c82eaf3b50d725892"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "37eaf520f784b85394b4050fecff40e4"
server_key_iv: "b3f2e12027e1cda687a70360b0f3b398"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.138180 11874 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:50:18.140731 11889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.142082 11874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 09:50:18.142241 11874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "30f06539559b4d7c82eaf3b50d725892"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "37eaf520f784b85394b4050fecff40e4"
server_key_iv: "b3f2e12027e1cda687a70360b0f3b398"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.142381 11874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:18.163316 11874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:18.167245 11874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:18.167515 11874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:18.168473 11874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:18.169813 11874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:18.169889 11874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.169977 11874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:18.170032 11874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.192553 11874 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:43485
I20260812 09:50:18.192720 12023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:43485 every 8 connection(s)
I20260812 09:50:18.193665 11874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:18.200311 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 11874
I20260812 09:50:18.200522 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:18.200847 11738 external_mini_cluster.cc:1428] Setting key 1dc0df0addae9279be9e2f25c6d56ace
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:18.211057 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.196240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:48923 (local address 127.11.118.190:45287)
0812 09:50:18.196409 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:18.196414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:18.197788 (+ 1374us) server_negotiation.cc:407] Connection header received
0812 09:50:18.199019 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:18.199022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:18.199080 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:18.199160 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:18.200972 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.201550 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.203365 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.203620 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.203708 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.207038 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:18.207042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:18.207044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:18.207068 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:18.208787 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.209369 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.209372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.209374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.209465 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.209830 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.209835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.209837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.210043 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:18.210158 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:18.210696 (+ 538us) server_negotiation.cc:299] Negotiation successful
0812 09:50:18.210845 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 09:50:18.211994 12026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.196648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45287 (local address 127.11.118.129:48923)
0812 09:50:18.197625 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:18.197671 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:18.198736 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:18.199296 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:18.199302 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:18.199809 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:18.200661 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.200686 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.201701 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.201703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.203234 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.203249 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.203796 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.203803 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.204112 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.204974 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:18.205008 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:18.206820 (+ 1812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:18.208926 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.208933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.208950 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.209245 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.209565 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.209569 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.209571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.209730 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.210158 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:18.210167 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:18.210449 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 09:50:18.210656 (+ 207us) client_negotiation.cc:240] Negotiation successful
0812 09:50:18.211041 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":220,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:18.213826 12024 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45287
I20260812 09:50:18.214059 12024 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:18.214578 12024 heartbeater.cc:511] Master 127.11.118.190:45287 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:18.216892 11800 ts_manager.cc:194] Registered new tserver with Master: 30f06539559b4d7c82eaf3b50d725892 (127.11.118.129:43485)
I20260812 09:50:18.219166 11800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:48923
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:18.239606 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:18.407776 12030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:18.408123 12030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:18.408221 12030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:18.412716 12030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:18.412832 12030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:18.412940 12030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:18.419025 12030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:18.420288 12030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:18.421391 12030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:18.432438 12038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.432391 12035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.432358 12036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:18.432683 12030 server_base.cc:1034] running on GCE node
I20260812 09:50:18.433204 12030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:18.433930 12030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:18.435102 12030 hybrid_clock.cc:648] HybridClock initialized: now 1786528218435066 us; error 50 us; skew 500 ppm
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:18.438169 12030 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:18.439234 12030 webserver.cc:460] Webserver started at http://127.11.118.130:40747/ using document root <none> and password file <none>
I20260812 09:50:18.439833 12030 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:18.439939 12030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:18.440184 12030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:18.442410 12030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "d06882e16b09468eb9c607d732f490f5"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "e8237559653f7d87cadbdd6a64fb8a23"
server_key_iv: "817afbbc2af77b1d1c563ced7605ca77"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.443130 12030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "d06882e16b09468eb9c607d732f490f5"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "e8237559653f7d87cadbdd6a64fb8a23"
server_key_iv: "817afbbc2af77b1d1c563ced7605ca77"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.447772 12030 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:50:18.450814 12046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.452216 12030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:50:18.452330 12030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "d06882e16b09468eb9c607d732f490f5"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "e8237559653f7d87cadbdd6a64fb8a23"
server_key_iv: "817afbbc2af77b1d1c563ced7605ca77"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.452438 12030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:18.465523 12030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:18.469092 12030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:18.469300 12030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:18.470073 12030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:18.471141 12030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:18.471195 12030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.471261 12030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:18.471293 12030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.492504 12030 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:36321
I20260812 09:50:18.492690 12177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:36321 every 8 connection(s)
I20260812 09:50:18.493557 12030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:18.499351 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12030
I20260812 09:50:18.499454 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:18.499693 11738 external_mini_cluster.cc:1428] Setting key c2095f734f1557ade0f1f7404ed1a009
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:18.511013 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.496116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:55289 (local address 127.11.118.190:45287)
0812 09:50:18.496266 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:18.496270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:18.497582 (+ 1312us) server_negotiation.cc:407] Connection header received
0812 09:50:18.498767 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:18.498770 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:18.498831 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:18.498917 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:18.500492 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.501075 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.502916 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.503220 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.503306 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.506842 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:18.506846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:18.506850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:18.506877 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:18.508654 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.509279 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.509283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.509286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.509375 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.509755 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.509760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.509762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.509983 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:18.510101 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:18.510644 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 09:50:18.510787 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:50:18.512009 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.496531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45287 (local address 127.11.118.130:55289)
0812 09:50:18.497408 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:18.497460 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:18.498549 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:18.499110 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:18.499117 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:18.499599 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:18.500334 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.500363 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.501204 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.501226 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.502779 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.502793 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.503391 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.503398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.503772 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.504706 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:18.504726 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:18.506636 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:18.508807 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.508814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.508832 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.509153 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.509486 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.509489 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.509491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.509652 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.510101 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:18.510109 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:18.510391 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 09:50:18.510604 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 09:50:18.511046 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":166,"threads_started":1}
I20260812 09:50:18.513489 12178 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45287
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:18.513797 12178 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:18.514441 12178 heartbeater.cc:511] Master 127.11.118.190:45287 requested a full tablet report, sending...
I20260812 09:50:18.515695 11800 ts_manager.cc:194] Registered new tserver with Master: d06882e16b09468eb9c607d732f490f5 (127.11.118.130:36321)
I20260812 09:50:18.516322 11800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:55289
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:18.539673 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:18.714344 12185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:18.714709 12185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:18.714826 12185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:18.719386 12185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:18.719509 12185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:18.719612 12185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:18.726543 12185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:18.727799 12185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:18.728907 12185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:18.741950 12192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.742242 12191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:18.741827 12194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:18.742533 12185 server_base.cc:1034] running on GCE node
I20260812 09:50:18.743203 12185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:18.744138 12185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:18.747485 12185 hybrid_clock.cc:648] HybridClock initialized: now 1786528218747411 us; error 85 us; skew 500 ppm
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:18.752470 12185 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:18.753490 12185 webserver.cc:460] Webserver started at http://127.11.118.131:38775/ using document root <none> and password file <none>
I20260812 09:50:18.754226 12185 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:18.754330 12185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:18.754575 12185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:18.757306 12185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "378e7dbed27e485c8e7b7818c962bb6e"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "dc4f2337a5621ef084f601c364291cce"
server_key_iv: "7e704b9460a37250c8e15318d88ccde4"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.758059 12185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "378e7dbed27e485c8e7b7818c962bb6e"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "dc4f2337a5621ef084f601c364291cce"
server_key_iv: "7e704b9460a37250c8e15318d88ccde4"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.765359 12185 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260812 09:50:18.770289 12203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.772676 12185 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:50:18.772897 12185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "378e7dbed27e485c8e7b7818c962bb6e"
format_stamp: "Formatted at 2026-08-12 09:50:18 on dist-test-slave-2w3w"
server_key: "dc4f2337a5621ef084f601c364291cce"
server_key_iv: "7e704b9460a37250c8e15318d88ccde4"
server_key_version: "encryptionkey@0"
I20260812 09:50:18.773151 12185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:18.798112 12185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:18.803298 12185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:18.803622 12185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:18.804560 12185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:18.805907 12185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:18.806023 12185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.806128 12185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:18.806197 12185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:18.825013 12185 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:44053
I20260812 09:50:18.825070 12337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:44053 every 8 connection(s)
I20260812 09:50:18.826078 12185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:18.829962 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12185
I20260812 09:50:18.830084 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:18.830385 11738 external_mini_cluster.cc:1428] Setting key f665091d8f4834daaedc2be94e0336e4
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:18.842859 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.828310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:57581 (local address 127.11.118.190:45287)
0812 09:50:18.828502 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:18.828518 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:18.829622 (+ 1104us) server_negotiation.cc:407] Connection header received
0812 09:50:18.830917 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:18.830924 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:18.831050 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:18.831175 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:18.833234 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.833937 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.835492 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.835713 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.835852 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.838792 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:18.838795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:18.838797 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:18.838826 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:18.840470 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.841011 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.841014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.841015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.841124 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.841544 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.841547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.841548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.841814 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:18.841903 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:18.842576 (+ 673us) server_negotiation.cc:299] Negotiation successful
0812 09:50:18.842689 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:50:18.843868 12341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.828674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45287 (local address 127.11.118.131:57581)
0812 09:50:18.829459 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:18.829506 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:18.830676 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:18.831391 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:18.831401 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:18.832099 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:18.833053 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.833077 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.834065 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.834068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.835293 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:18.835303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.835909 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.835912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:18.836120 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.836798 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:18.836815 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:18.838581 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:18.840596 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.840602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.840616 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.840889 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.841258 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:18.841261 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:18.841262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:18.841428 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:18.841975 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:18.841981 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:18.842288 (+ 307us) client_negotiation.cc:769] Sending connection context
0812 09:50:18.842475 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 09:50:18.842779 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":121,"threads_started":1}
I20260812 09:50:18.845281 12338 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45287
I20260812 09:50:18.845614 12338 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:18.846424 12338 heartbeater.cc:511] Master 127.11.118.190:45287 requested a full tablet report, sending...
I20260812 09:50:18.848033 11799 ts_manager.cc:194] Registered new tserver with Master: 378e7dbed27e485c8e7b7818c962bb6e (127.11.118.131:44053)
I20260812 09:50:18.848698 11799 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:57581
I20260812 09:50:18.858685 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:18.890307 12347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.879362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.11.118.129:43485)
0812 09:50:18.879714 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:18.879722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:18.879788 (+ 66us) server_negotiation.cc:407] Connection header received
0812 09:50:18.879949 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:18.879954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:18.880144 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:18.880271 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:18.881050 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.882110 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.883082 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.883523 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.883612 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.886288 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:18.886301 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:18.886315 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:18.886346 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:18.888245 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.888725 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.888730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.888731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.888820 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.889177 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.889180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.889181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.889453 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:18.889625 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:18.889880 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 09:50:18.890027 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":114,"threads_started":1}
W20260812 09:50:18.891680 11920 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55256
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 09:50:18 dist-test-slave-2w3w krb5kdc[11746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:18.923305 12347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:18.913236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.11.118.129:43485)
0812 09:50:18.913474 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:18.913479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:18.913600 (+ 121us) server_negotiation.cc:407] Connection header received
0812 09:50:18.913783 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:18.913789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:18.913851 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:18.913952 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:18.914714 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.915338 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.916209 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:18.916448 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:18.916565 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:18.919526 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:18.919529 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:18.919531 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:18.919565 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:18.921244 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.921821 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.921825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.921827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.921920 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:18.922252 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:18.922256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:18.922258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:18.922468 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:18.922634 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:18.922921 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 09:50:18.923099 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 09:50:18.924623 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 11874
I20260812 09:50:18.936384 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12030
I20260812 09:50:18.945374 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12185
I20260812 09:50:18.959409 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 11762
2026-08-12T09:50:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2736 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:19 dist-test-slave-2w3w krb5kdc[12358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:19 dist-test-slave-2w3w krb5kdc[12358](info): set up 2 sockets
Aug 12 09:50:19 dist-test-slave-2w3w krb5kdc[12358](info): commencing operation
krb5kdc: starting...
W20260812 09:50:20.094703 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:20.242900 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44717
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:44717
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:20.360710 12372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:20.361052 12372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:20.361128 12372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:20.365311 12372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:20.365428 12372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:20.365468 12372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:20.365506 12372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:20.365542 12372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:20.371071 12372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:44717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:20.372275 12372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:20.373366 12372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:20.382689 12382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:20.382757 12378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:20.382771 12379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:20.382999 12372 server_base.cc:1034] running on GCE node
I20260812 09:50:20.383658 12372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:20.384838 12372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:20.386040 12372 hybrid_clock.cc:648] HybridClock initialized: now 1786528220386027 us; error 27 us; skew 500 ppm
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:20.389024 12372 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:20.390045 12372 webserver.cc:460] Webserver started at http://127.11.118.190:41285/ using document root <none> and password file <none>
I20260812 09:50:20.390652 12372 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:20.390758 12372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:20.391068 12372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:20.393227 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "a1434f066d974b4b9c630fab2c7368e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "a3e3c0f2fecf1a9eab31d9d92fd94ae0"
server_key_iv: "70b61e98c7bfa05ab5e072e459a29daf"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.393846 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "a1434f066d974b4b9c630fab2c7368e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "a3e3c0f2fecf1a9eab31d9d92fd94ae0"
server_key_iv: "70b61e98c7bfa05ab5e072e459a29daf"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.397884 12372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:20.400579 12389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.401948 12372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:20.402103 12372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "a1434f066d974b4b9c630fab2c7368e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "a3e3c0f2fecf1a9eab31d9d92fd94ae0"
server_key_iv: "70b61e98c7bfa05ab5e072e459a29daf"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.402231 12372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:20.437817 12372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:20.441462 12372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:20.441687 12372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:20.449851 12372 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:44717
I20260812 09:50:20.449879 12449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:44717 every 8 connection(s)
I20260812 09:50:20.450898 12372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:20.451516 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12372
I20260812 09:50:20.451668 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:20.451965 11738 external_mini_cluster.cc:1428] Setting key 89c9ead8d4e530b4811bf3f305f360ca
I20260812 09:50:20.455232 12450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:20.462724 12450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2: Bootstrap starting.
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:20.465904 12450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:20.466894 12450 log.cc:824] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:20.469648 12450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2: No bootstrap required, opened a new log
I20260812 09:50:20.469660 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:20.453801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53176 (local address 127.11.118.190:44717)
0812 09:50:20.454285 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:20.454306 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:20.454351 (+ 45us) server_negotiation.cc:407] Connection header received
0812 09:50:20.455316 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:20.455343 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:20.455790 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:20.456177 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:20.456969 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.458506 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.459708 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.460508 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.460709 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:20.463793 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:20.463801 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:20.463818 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:20.463855 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:20.466120 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:20.466636 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:20.466642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:20.466650 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:20.466818 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:20.467256 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:20.467260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:20.467261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:20.467764 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:20.467935 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:20.468358 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 09:50:20.468678 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":139,"threads_started":1}
I20260812 09:50:20.475265 12450 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } }
I20260812 09:50:20.475533 12450 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:20.475580 12450 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1434f066d974b4b9c630fab2c7368e2, State: Initialized, Role: FOLLOWER
I20260812 09:50:20.475968 12450 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } }
I20260812 09:50:20.476079 12450 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:20.476118 12450 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:20.476190 12450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:20.477273 12450 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } }
I20260812 09:50:20.477638 12450 leader_election.cc:302] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1434f066d974b4b9c630fab2c7368e2; no voters:
I20260812 09:50:20.477988 12450 leader_election.cc:288] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:20.478200 12455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:20.478586 12455 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [term 1 LEADER]: Becoming Leader. State: Replica: a1434f066d974b4b9c630fab2c7368e2, State: Running, Role: LEADER
I20260812 09:50:20.479019 12455 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } }
I20260812 09:50:20.479547 12450 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:20.481050 12456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1434f066d974b4b9c630fab2c7368e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } } }
I20260812 09:50:20.481081 12458 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1434f066d974b4b9c630fab2c7368e2. Latest consensus state: current_term: 1 leader_uuid: "a1434f066d974b4b9c630fab2c7368e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1434f066d974b4b9c630fab2c7368e2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44717 } } }
I20260812 09:50:20.481207 12458 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:20.481207 12456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:20.481726 12470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:20.484699 12470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:20.490746 12470 catalog_manager.cc:1347] Generated new cluster ID: 2373f66dfcf848bb949cc3d603dc515c
I20260812 09:50:20.490835 12470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:20.508301 12470 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:20.509742 12470 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:20.530360 12470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1434f066d974b4b9c630fab2c7368e2: Generated new TSK 0
I20260812 09:50:20.531364 12470 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:20.568337 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:20.697712 12479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:20.698024 12479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:20.698074 12479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:20.702304 12479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:20.702382 12479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:20.702445 12479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:20.708196 12479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:20.709280 12479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:20.710255 12479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:50:20.720448 12479 server_base.cc:1034] running on GCE node
W20260812 09:50:20.720417 12485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:20.720407 12487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:20.720597 12484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:20.721067 12479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:20.721671 12479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:20.722838 12479 hybrid_clock.cc:648] HybridClock initialized: now 1786528220722809 us; error 44 us; skew 500 ppm
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:20.725771 12479 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:20.726744 12479 webserver.cc:460] Webserver started at http://127.11.118.129:40083/ using document root <none> and password file <none>
I20260812 09:50:20.727382 12479 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:20.727480 12479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:20.727717 12479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:20.729779 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "91e149dd56724c61b52c52ed0c4e1ced"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "5d1336cbddfdb353bb4aece8769450a6"
server_key_iv: "4ea317c18ecd263c5eb916628acc9525"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.730376 12479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "91e149dd56724c61b52c52ed0c4e1ced"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "5d1336cbddfdb353bb4aece8769450a6"
server_key_iv: "4ea317c18ecd263c5eb916628acc9525"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.734303 12479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:20.737093 12494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.738389 12479 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 09:50:20.738547 12479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "91e149dd56724c61b52c52ed0c4e1ced"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "5d1336cbddfdb353bb4aece8769450a6"
server_key_iv: "4ea317c18ecd263c5eb916628acc9525"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.738675 12479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:20.759393 12479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:20.762712 12479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:20.763002 12479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:20.763671 12479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:20.764609 12479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:20.764686 12479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.764760 12479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:20.764814 12479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.774269 12479 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38469
I20260812 09:50:20.774353 12622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38469 every 8 connection(s)
I20260812 09:50:20.775341 12479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:20.777724 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12479
I20260812 09:50:20.777814 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:20.778115 11738 external_mini_cluster.cc:1428] Setting key 77391ce1f7d799799160c6c25cbe7a8c
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:20.790160 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:20.777393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:49705 (local address 127.11.118.190:44717)
0812 09:50:20.777565 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:20.777570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:20.778599 (+ 1029us) server_negotiation.cc:407] Connection header received
0812 09:50:20.779780 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:20.779784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:20.779835 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:20.779942 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:20.781283 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.782213 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.783476 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.783731 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.783816 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:20.786455 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:20.786458 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:20.786460 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:20.786485 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:20.787990 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:20.788550 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:20.788554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:20.788556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:20.788640 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:20.788992 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:20.788997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:20.788998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:20.789186 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:20.789301 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:20.789843 (+ 542us) server_negotiation.cc:299] Negotiation successful
0812 09:50:20.789979 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:20.791124 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:20.777846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44717 (local address 127.11.118.129:49705)
0812 09:50:20.778410 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:20.778470 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:20.779549 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:20.780128 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:20.780138 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:20.780539 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:20.781092 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:20.781108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.782358 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.782361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:20.783353 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:20.783363 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:20.783911 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:20.783913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:20.784063 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:20.784717 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:20.784735 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:20.786263 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:20.788130 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:20.788136 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:20.788152 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:20.788440 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:20.788734 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:20.788738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:20.788740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:20.788892 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:20.789334 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:20.789340 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:20.789595 (+ 255us) client_negotiation.cc:769] Sending connection context
0812 09:50:20.789793 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 09:50:20.790129 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:20.792472 12623 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44717
I20260812 09:50:20.792729 12623 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:20.793239 12623 heartbeater.cc:511] Master 127.11.118.190:44717 requested a full tablet report, sending...
I20260812 09:50:20.794832 12406 ts_manager.cc:194] Registered new tserver with Master: 91e149dd56724c61b52c52ed0c4e1ced (127.11.118.129:38469)
I20260812 09:50:20.795997 12406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:49705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:20.811470 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:20.931753 12629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:20.932075 12629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:20.932124 12629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:20.936331 12629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:20.936415 12629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:20.936482 12629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:20.942308 12629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:20.943609 12629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:20.944677 12629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:20.955295 12637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:20.955300 12634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:20.955531 12629 server_base.cc:1034] running on GCE node
W20260812 09:50:20.955322 12635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:20.956059 12629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:20.956876 12629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:20.958145 12629 hybrid_clock.cc:648] HybridClock initialized: now 1786528220958128 us; error 30 us; skew 500 ppm
Aug 12 09:50:20 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:20.961593 12629 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:20.963228 12629 webserver.cc:460] Webserver started at http://127.11.118.130:43671/ using document root <none> and password file <none>
I20260812 09:50:20.963994 12629 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:20.964138 12629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:20.964421 12629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:20.967208 12629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "cedfa980c5fd44ffbddac9625baa60e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "b029a99d4c6c367a06c818573701e1aa"
server_key_iv: "8e0cf35eaf71d0d3f698e57727b051cd"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.967890 12629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "cedfa980c5fd44ffbddac9625baa60e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "b029a99d4c6c367a06c818573701e1aa"
server_key_iv: "8e0cf35eaf71d0d3f698e57727b051cd"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.972751 12629 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:20.975983 12644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.977664 12629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:50:20.977854 12629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "cedfa980c5fd44ffbddac9625baa60e2"
format_stamp: "Formatted at 2026-08-12 09:50:20 on dist-test-slave-2w3w"
server_key: "b029a99d4c6c367a06c818573701e1aa"
server_key_iv: "8e0cf35eaf71d0d3f698e57727b051cd"
server_key_version: "encryptionkey@0"
I20260812 09:50:20.978017 12629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:20.990926 12629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:20.995198 12629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:20.995445 12629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:20.996135 12629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:20.997093 12629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:20.997229 12629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:20.997361 12629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:20.997422 12629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:21.008740 12629 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:33391
I20260812 09:50:21.008775 12773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:33391 every 8 connection(s)
I20260812 09:50:21.009843 12629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:21.019752 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12629
I20260812 09:50:21.019897 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:21.020169 11738 external_mini_cluster.cc:1428] Setting key 9a0383b766461c502ce2327d1d2bcb80
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:21.026660 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.012302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:36511 (local address 127.11.118.190:44717)
0812 09:50:21.012499 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.012503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.013736 (+ 1233us) server_negotiation.cc:407] Connection header received
0812 09:50:21.014687 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.014690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.014755 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.014840 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.016246 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.016837 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.018180 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.018408 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.018504 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.021689 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.021693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.021696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.021725 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.023523 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.024386 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.024391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.024393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.024529 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.024975 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.024980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.024983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.025328 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.025449 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.026198 (+ 749us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.026380 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 09:50:21.027488 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.012697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44717 (local address 127.11.118.130:36511)
0812 09:50:21.013548 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.013606 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.014484 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.015083 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.015090 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.015518 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:21.016062 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.016077 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.016992 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.016995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.018025 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.018036 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.018570 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.018573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.018732 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.019534 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:21.019552 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:21.021450 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:21.023679 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:21.023692 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:21.023717 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:21.024232 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:21.024660 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:21.024662 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:21.024664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:21.024857 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:21.025474 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:21.025480 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:21.025810 (+ 330us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.026009 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.026432 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":139,"threads_started":1}
I20260812 09:50:21.028807 12774 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44717
I20260812 09:50:21.029064 12774 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:21.029704 12774 heartbeater.cc:511] Master 127.11.118.190:44717 requested a full tablet report, sending...
I20260812 09:50:21.031035 12406 ts_manager.cc:194] Registered new tserver with Master: cedfa980c5fd44ffbddac9625baa60e2 (127.11.118.130:33391)
I20260812 09:50:21.031652 12406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:36511
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:21.059392 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:21.183259 12779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:21.183612 12779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:21.183661 12779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:21.188093 12779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:21.188167 12779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:21.188241 12779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:21.193905 12779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44717
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:21.195216 12779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:21.196252 12779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:21.206633 12789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:21.206691 12779 server_base.cc:1034] running on GCE node
W20260812 09:50:21.206642 12785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:21.206629 12786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:21.207521 12779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:21.208566 12779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:21.209784 12779 hybrid_clock.cc:648] HybridClock initialized: now 1786528221209749 us; error 50 us; skew 500 ppm
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:21.213114 12779 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:21.214046 12779 webserver.cc:460] Webserver started at http://127.11.118.131:42369/ using document root <none> and password file <none>
I20260812 09:50:21.214617 12779 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:21.214679 12779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:21.214872 12779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:21.217166 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "77577471c88c433a959ea839459f415c"
format_stamp: "Formatted at 2026-08-12 09:50:21 on dist-test-slave-2w3w"
server_key: "e37c2f8c2a13a81d71dade0eb6a6bfa9"
server_key_iv: "48643e559f02754b76fa4930054552ed"
server_key_version: "encryptionkey@0"
I20260812 09:50:21.217730 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "77577471c88c433a959ea839459f415c"
format_stamp: "Formatted at 2026-08-12 09:50:21 on dist-test-slave-2w3w"
server_key: "e37c2f8c2a13a81d71dade0eb6a6bfa9"
server_key_iv: "48643e559f02754b76fa4930054552ed"
server_key_version: "encryptionkey@0"
I20260812 09:50:21.222057 12779 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:21.224902 12796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:21.226656 12779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:21.226811 12779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "77577471c88c433a959ea839459f415c"
format_stamp: "Formatted at 2026-08-12 09:50:21 on dist-test-slave-2w3w"
server_key: "e37c2f8c2a13a81d71dade0eb6a6bfa9"
server_key_iv: "48643e559f02754b76fa4930054552ed"
server_key_version: "encryptionkey@0"
I20260812 09:50:21.226931 12779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:21.245445 12779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:21.249055 12779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:21.249238 12779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:21.249850 12779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:21.250754 12779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:21.250828 12779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:21.250898 12779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:21.250946 12779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:21.260396 12779 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:46369
I20260812 09:50:21.260423 12925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:46369 every 8 connection(s)
I20260812 09:50:21.261355 12779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:21.268070 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12779
I20260812 09:50:21.268191 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:21.268500 11738 external_mini_cluster.cc:1428] Setting key c95605a6003982375bf0f4249c8c9583
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:21.275735 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.263318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:35569 (local address 127.11.118.190:44717)
0812 09:50:21.263492 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.263496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.264392 (+ 896us) server_negotiation.cc:407] Connection header received
0812 09:50:21.265279 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.265281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.265332 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.265415 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.266649 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.267202 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.268517 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.268826 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.268972 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.271994 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.271998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.272001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.272030 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.273349 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.273911 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.273917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.273922 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.274018 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.274400 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.274404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.274405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.274638 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.274768 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.275415 (+ 647us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.275565 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 09:50:21.276643 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.263707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44717 (local address 127.11.118.131:35569)
0812 09:50:21.264216 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.264261 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.265074 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.265592 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.265598 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.265979 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:21.266511 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.266526 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.267354 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.267358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.268382 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.268393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.269053 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.269058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.269275 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.270018 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:21.270040 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:21.271809 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:21.273489 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:21.273496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:21.273515 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:21.273798 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:21.274122 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:21.274125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:21.274127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:21.274290 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:21.274781 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:21.274790 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:21.275152 (+ 362us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.275365 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.275737 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":148,"threads_started":1}
I20260812 09:50:21.278090 12927 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44717
I20260812 09:50:21.278434 12927 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:21.279083 12927 heartbeater.cc:511] Master 127.11.118.190:44717 requested a full tablet report, sending...
I20260812 09:50:21.280395 12406 ts_manager.cc:194] Registered new tserver with Master: 77577471c88c433a959ea839459f415c (127.11.118.131:46369)
I20260812 09:50:21.281188 12406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:35569
I20260812 09:50:21.283318 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:21.296890 12453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.288492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53186 (local address 127.11.118.190:44717)
0812 09:50:21.288664 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.288667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.288823 (+ 156us) server_negotiation.cc:407] Connection header received
0812 09:50:21.288933 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.288936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.288986 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.289081 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.289846 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.290397 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.291424 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.291652 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.291754 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.293638 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.293641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.293643 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.293682 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.295256 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.295721 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.295724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.295725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.295806 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.296060 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.296062 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.296063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.296303 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.296437 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.296654 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.296758 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:50:21.303511 12406 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:21.307222 12406 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:21.323522 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.317591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40906 (local address 127.11.118.129:38469)
0812 09:50:21.317934 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.317941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.318384 (+ 443us) server_negotiation.cc:407] Connection header received
0812 09:50:21.318650 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.318656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.318870 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.319035 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:21.319531 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.320362 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.321915 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.322721 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.322853 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.323117 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.323237 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.323341 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":156,"threads_started":1}
I20260812 09:50:21.323949 12941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.317457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38469 (local address 127.0.0.1:40906)
0812 09:50:21.318226 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.318280 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.318478 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.319231 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.319238 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.319263 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:21.319376 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.319381 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.320496 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.320498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.321755 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.321766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.322853 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.322857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.323005 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.323052 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.323190 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.323346 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":135,"threads_started":1}
I20260812 09:50:21.323951 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.318240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:46369 (local address 127.0.0.1:51446)
0812 09:50:21.318660 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.318672 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.318755 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.319455 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.319459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.319477 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:21.319575 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.319585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.321004 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.321008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.322211 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.322221 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.323519 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.323524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.323627 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.323660 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.323735 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.323809 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":36,"thread_start_us":108,"threads_started":1}
I20260812 09:50:21.324189 12939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.317838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33391 (local address 127.0.0.1:60562)
0812 09:50:21.318269 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.318285 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.318419 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.319541 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.319544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.319562 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:21.319668 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.319674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.321238 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.321245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.322549 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.322560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.323782 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.323786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.323881 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.323901 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.323943 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.323994 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":188,"thread_start_us":114,"threads_started":1}
I20260812 09:50:21.324929 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.318677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51446 (local address 127.11.118.131:46369)
0812 09:50:21.319026 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.319038 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.319061 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:50:21.319135 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.319141 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.319311 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.319472 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:21.319674 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.320843 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.322350 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.323276 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.324085 (+ 809us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.324232 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.324298 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.324426 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":106,"threads_started":1}
I20260812 09:50:21.324942 12942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.318188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60562 (local address 127.11.118.130:33391)
0812 09:50:21.319132 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.319143 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.319162 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:50:21.319226 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.319230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.319375 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.319820 (+ 445us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:21.319984 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.321090 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.322692 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.323631 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.324556 (+ 925us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.324677 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.324723 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.324808 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":848,"thread_start_us":127,"threads_started":1}
I20260812 09:50:21.327797 12852 tablet_service.cc:1467] Processing CreateTablet for tablet be56f866087640019cf7fa805003537b (DEFAULT_TABLE table=test-table [id=b802f1c07a9949699000f938aaf76acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:21.327821 12548 tablet_service.cc:1467] Processing CreateTablet for tablet be56f866087640019cf7fa805003537b (DEFAULT_TABLE table=test-table [id=b802f1c07a9949699000f938aaf76acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:21.327823 12698 tablet_service.cc:1467] Processing CreateTablet for tablet be56f866087640019cf7fa805003537b (DEFAULT_TABLE table=test-table [id=b802f1c07a9949699000f938aaf76acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:21.329033 12698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be56f866087640019cf7fa805003537b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:21.329079 12852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be56f866087640019cf7fa805003537b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:21.330495 12548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be56f866087640019cf7fa805003537b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:21.336756 12945 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Bootstrap starting.
I20260812 09:50:21.337414 12946 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Bootstrap starting.
I20260812 09:50:21.338171 12947 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Bootstrap starting.
I20260812 09:50:21.340128 12947 tablet_bootstrap.cc:654] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:21.340133 12946 tablet_bootstrap.cc:654] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:21.340968 12945 tablet_bootstrap.cc:654] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:21.341485 12947 log.cc:824] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:21.341739 12945 log.cc:824] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:21.344202 12947 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: No bootstrap required, opened a new log
I20260812 09:50:21.344504 12947 ts_tablet_manager.cc:1397] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 09:50:21.344560 12946 log.cc:824] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:21.344779 12945 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: No bootstrap required, opened a new log
I20260812 09:50:21.344991 12945 ts_tablet_manager.cc:1397] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 09:50:21.347754 12946 tablet_bootstrap.cc:492] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: No bootstrap required, opened a new log
I20260812 09:50:21.348047 12946 ts_tablet_manager.cc:1397] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260812 09:50:21.349937 12945 raft_consensus.cc:348] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.350262 12945 raft_consensus.cc:374] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:21.350344 12945 raft_consensus.cc:729] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cedfa980c5fd44ffbddac9625baa60e2, State: Initialized, Role: FOLLOWER
I20260812 09:50:21.350824 12945 consensus_queue.cc:260] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.351814 12774 heartbeater.cc:503] Master 127.11.118.190:44717 was elected leader, sending a full tablet report...
I20260812 09:50:21.352414 12945 ts_tablet_manager.cc:1428] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:50:21.352123 12947 raft_consensus.cc:348] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.352521 12947 raft_consensus.cc:374] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:21.352617 12947 raft_consensus.cc:729] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e149dd56724c61b52c52ed0c4e1ced, State: Initialized, Role: FOLLOWER
I20260812 09:50:21.353252 12947 consensus_queue.cc:260] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.354305 12623 heartbeater.cc:503] Master 127.11.118.190:44717 was elected leader, sending a full tablet report...
I20260812 09:50:21.354703 12947 ts_tablet_manager.cc:1428] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Time spent starting tablet: real 0.010s user 0.003s sys 0.007s
I20260812 09:50:21.355001 12946 raft_consensus.cc:348] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.355386 12946 raft_consensus.cc:374] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:21.355453 12946 raft_consensus.cc:729] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77577471c88c433a959ea839459f415c, State: Initialized, Role: FOLLOWER
I20260812 09:50:21.355926 12946 consensus_queue.cc:260] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.357299 12946 ts_tablet_manager.cc:1428] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Time spent starting tablet: real 0.009s user 0.006s sys 0.004s
I20260812 09:50:21.358142 12927 heartbeater.cc:503] Master 127.11.118.190:44717 was elected leader, sending a full tablet report...
I20260812 09:50:21.412436 12952 raft_consensus.cc:482] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:21.412717 12952 raft_consensus.cc:504] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.414014 12952 leader_election.cc:288] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91e149dd56724c61b52c52ed0c4e1ced (127.11.118.129:38469), 77577471c88c433a959ea839459f415c (127.11.118.131:46369)
I20260812 09:50:21.419088 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.414666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:53907 (local address 127.11.118.129:38469)
0812 09:50:21.414825 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.414830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.414850 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:50:21.414951 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.414983 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.415038 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.415143 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:21.415561 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.416225 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.417786 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.418374 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.418521 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.418578 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.418855 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.418942 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:50:21.419088 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.414473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38469 (local address 127.11.118.130:53907)
0812 09:50:21.414637 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.414654 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.414775 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.415176 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.415179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.415199 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:21.415413 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.415423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.416338 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.416344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.417656 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.417666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.418518 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.418522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.418719 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.418738 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.418836 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.418916 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 09:50:21.419919 12573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be56f866087640019cf7fa805003537b" candidate_uuid: "cedfa980c5fd44ffbddac9625baa60e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e149dd56724c61b52c52ed0c4e1ced" is_pre_election: true
I20260812 09:50:21.420066 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.415201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:33927 (local address 127.11.118.131:46369)
0812 09:50:21.415380 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.415385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.415642 (+ 257us) server_negotiation.cc:407] Connection header received
0812 09:50:21.415819 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.415821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.415860 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.415945 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:21.416417 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.417233 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.418664 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.419178 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.419317 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.419365 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.419875 (+ 510us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.419960 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:50:21.420107 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.414793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:46369 (local address 127.11.118.130:33927)
0812 09:50:21.415516 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:21.415529 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:21.415678 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:21.415963 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:21.415966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:21.415981 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:21.416260 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.416269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.417356 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.417359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.418524 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:21.418534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.419577 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.419585 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:21.419728 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.419747 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:50:21.419855 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 09:50:21.419928 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":289,"threads_started":1}
I20260812 09:50:21.420430 12573 raft_consensus.cc:2454] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cedfa980c5fd44ffbddac9625baa60e2 in term 0.
I20260812 09:50:21.420898 12872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be56f866087640019cf7fa805003537b" candidate_uuid: "cedfa980c5fd44ffbddac9625baa60e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77577471c88c433a959ea839459f415c" is_pre_election: true
I20260812 09:50:21.421169 12647 leader_election.cc:302] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e149dd56724c61b52c52ed0c4e1ced, cedfa980c5fd44ffbddac9625baa60e2; no voters:
I20260812 09:50:21.421217 12872 raft_consensus.cc:2454] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cedfa980c5fd44ffbddac9625baa60e2 in term 0.
I20260812 09:50:21.421496 12952 raft_consensus.cc:2781] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:21.421617 12952 raft_consensus.cc:482] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:21.421672 12952 raft_consensus.cc:3037] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:21.423163 12952 raft_consensus.cc:504] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.423527 12952 leader_election.cc:288] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [CANDIDATE]: Term 1 election: Requested vote from peers 91e149dd56724c61b52c52ed0c4e1ced (127.11.118.129:38469), 77577471c88c433a959ea839459f415c (127.11.118.131:46369)
I20260812 09:50:21.423978 12573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be56f866087640019cf7fa805003537b" candidate_uuid: "cedfa980c5fd44ffbddac9625baa60e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91e149dd56724c61b52c52ed0c4e1ced"
I20260812 09:50:21.423998 12872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be56f866087640019cf7fa805003537b" candidate_uuid: "cedfa980c5fd44ffbddac9625baa60e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77577471c88c433a959ea839459f415c"
I20260812 09:50:21.424141 12872 raft_consensus.cc:3037] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:21.424108 12573 raft_consensus.cc:3037] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:21.425875 12573 raft_consensus.cc:2454] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cedfa980c5fd44ffbddac9625baa60e2 in term 1.
I20260812 09:50:21.425870 12872 raft_consensus.cc:2454] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cedfa980c5fd44ffbddac9625baa60e2 in term 1.
I20260812 09:50:21.426239 12647 leader_election.cc:302] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91e149dd56724c61b52c52ed0c4e1ced, cedfa980c5fd44ffbddac9625baa60e2; no voters:
I20260812 09:50:21.426486 12952 raft_consensus.cc:2781] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:21.426791 12952 raft_consensus.cc:686] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [term 1 LEADER]: Becoming Leader. State: Replica: cedfa980c5fd44ffbddac9625baa60e2, State: Running, Role: LEADER
I20260812 09:50:21.427188 12952 consensus_queue.cc:237] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } }
I20260812 09:50:21.430766 12404 catalog_manager.cc:5495] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cedfa980c5fd44ffbddac9625baa60e2 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "cedfa980c5fd44ffbddac9625baa60e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91e149dd56724c61b52c52ed0c4e1ced" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77577471c88c433a959ea839459f415c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 46369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cedfa980c5fd44ffbddac9625baa60e2" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33391 } health_report { overall_health: HEALTHY } } }
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:21.460739 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.442498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40908 (local address 127.11.118.129:38469)
0812 09:50:21.442673 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.442676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.443173 (+ 497us) server_negotiation.cc:407] Connection header received
0812 09:50:21.443359 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.443365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.443425 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.443520 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.444423 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.445067 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.446250 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.446477 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.446589 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.456112 (+ 9523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.456130 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.456145 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.456189 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.458613 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.459277 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.459284 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.459286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.459396 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.459694 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.459697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.459699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.460025 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.460218 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.460424 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.460577 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:21.494820 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.485133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.11.118.129:38469)
0812 09:50:21.485305 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.485310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.485507 (+ 197us) server_negotiation.cc:407] Connection header received
0812 09:50:21.485689 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.485692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.485736 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.485828 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.486567 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.487280 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.488202 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.488426 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.488509 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.491279 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.491282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.491289 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.491316 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.492939 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.493459 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.493463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.493464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.493560 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.493909 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.493912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.493913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.494131 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.494358 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.494539 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.494661 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260812 09:50:21.511324 12775 tablet.cc:2369] T be56f866087640019cf7fa805003537b P cedfa980c5fd44ffbddac9625baa60e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:21.512444 12928 tablet.cc:2369] T be56f866087640019cf7fa805003537b P 77577471c88c433a959ea839459f415c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:21.526412 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:21.516837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.11.118.129:38469)
0812 09:50:21.517034 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:21.517039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:21.517193 (+ 154us) server_negotiation.cc:407] Connection header received
0812 09:50:21.517379 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:21.517390 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:21.517436 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:21.517529 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:21.518357 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.518876 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.519869 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:21.520101 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:21.520221 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:21.523049 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:21.523053 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:21.523055 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:21.523085 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:21.524626 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.525120 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.525124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.525126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.525218 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:21.525533 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:21.525537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:21.525539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:21.525724 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:21.525861 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:21.526108 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 09:50:21.526234 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260812 09:50:21.526991 12625 tablet.cc:2369] T be56f866087640019cf7fa805003537b P 91e149dd56724c61b52c52ed0c4e1ced: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:21.528196 12524 tablet_service.cc:2908] Rejecting scan request for tablet be56f866087640019cf7fa805003537b: Uninitialized: clean time has not yet been initialized
I20260812 09:50:21.531136 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12479
I20260812 09:50:21.540944 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12629
I20260812 09:50:21.551100 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12779
I20260812 09:50:21.559880 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12372
2026-08-12T09:50:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2599 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12972](info): set up 2 sockets
Aug 12 09:50:21 dist-test-slave-2w3w krb5kdc[12972](info): commencing operation
krb5kdc: starting...
W20260812 09:50:22.704847 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:22 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:22.846570 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36385
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:36385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:22.967422 12989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:22.967806 12989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:22.967896 12989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:22.973060 12989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:22.973278 12989 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 09:50:22.973316 12989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:22.973361 12989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:22.973398 12989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:22.973438 12989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:22.979972 12989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:36385
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:22.981643 12989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:22.983083 12989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:22.992789 12998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:22.992759 12994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:22.992759 12995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:22.992945 12989 server_base.cc:1034] running on GCE node
I20260812 09:50:22.993788 12989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:22.995090 12989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:22.996338 12989 hybrid_clock.cc:648] HybridClock initialized: now 1786528222996310 us; error 54 us; skew 500 ppm
Aug 12 09:50:22 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:22.999682 12989 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:23.000806 12989 webserver.cc:460] Webserver started at http://127.11.118.190:36115/ using document root <none> and password file <none>
I20260812 09:50:23.001456 12989 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:23.001562 12989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:23.001833 12989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:23.004235 12989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "aa0d3ea9eccd4365a85356e0a09e746a"
format_stamp: "Formatted at 2026-08-12 09:50:22 on dist-test-slave-2w3w"
server_key: "98d71dd122e6173dedeeb8b71493855f"
server_key_iv: "e10ecaf158da413ac6bcab244fb97c86"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.004917 12989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "aa0d3ea9eccd4365a85356e0a09e746a"
format_stamp: "Formatted at 2026-08-12 09:50:22 on dist-test-slave-2w3w"
server_key: "98d71dd122e6173dedeeb8b71493855f"
server_key_iv: "e10ecaf158da413ac6bcab244fb97c86"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.009246 12989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:23.012028 13005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.013504 12989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:23.013684 12989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "aa0d3ea9eccd4365a85356e0a09e746a"
format_stamp: "Formatted at 2026-08-12 09:50:22 on dist-test-slave-2w3w"
server_key: "98d71dd122e6173dedeeb8b71493855f"
server_key_iv: "e10ecaf158da413ac6bcab244fb97c86"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.013827 12989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:23.030882 12989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:23.034614 12989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:23.034888 12989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:23.044184 12989 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:36385
I20260812 09:50:23.044250 13077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:36385 every 8 connection(s)
I20260812 09:50:23.045611 12989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:23.049600 13078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:23.054993 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 12989
I20260812 09:50:23.055135 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:23.055394 11738 external_mini_cluster.cc:1428] Setting key b2fd37fb08cc3d17c7c4929d3eb9af75
I20260812 09:50:23.057287 13078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Bootstrap starting.
I20260812 09:50:23.060432 13078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:23.061542 13078 log.cc:824] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:23.064179 13078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: No bootstrap required, opened a new log
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:23.068837 13078 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } }
I20260812 09:50:23.069232 13078 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:23.069304 13078 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0d3ea9eccd4365a85356e0a09e746a, State: Initialized, Role: FOLLOWER
I20260812 09:50:23.069862 13078 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } }
I20260812 09:50:23.070041 13078 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:23.070149 13078 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:23.070290 13078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:23.071705 13078 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } }
I20260812 09:50:23.072121 13078 leader_election.cc:302] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa0d3ea9eccd4365a85356e0a09e746a; no voters:
I20260812 09:50:23.072566 13078 leader_election.cc:288] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:23.072655 13084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:23.072952 13084 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [term 1 LEADER]: Becoming Leader. State: Replica: aa0d3ea9eccd4365a85356e0a09e746a, State: Running, Role: LEADER
I20260812 09:50:23.073292 13084 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } }
I20260812 09:50:23.074035 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.057387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38972 (local address 127.11.118.190:36385)
0812 09:50:23.057919 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.057939 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.057985 (+ 46us) server_negotiation.cc:407] Connection header received
0812 09:50:23.059011 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.059039 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.059512 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.059931 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.060813 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.062320 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.063364 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.064080 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.064265 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.067247 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.067255 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.067277 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.067321 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.069996 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.070707 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.070714 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.070721 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.070893 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.071276 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.071280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.071281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.071914 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.072130 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.072611 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.072995 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":141,"threads_started":1}
I20260812 09:50:23.074113 13078 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:23.074577 13084 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa0d3ea9eccd4365a85356e0a09e746a. Latest consensus state: current_term: 1 leader_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } } }
I20260812 09:50:23.074817 13084 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:23.075124 13084 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0d3ea9eccd4365a85356e0a09e746a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36385 } } }
I20260812 09:50:23.075294 13084 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:23.076637 13089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:23.080384 13089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:23.086259 13089 catalog_manager.cc:1347] Generated new cluster ID: fe001a4f0f6047dbbdc50b7994a7d17b
I20260812 09:50:23.086354 13089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:23.102185 13089 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:23.103623 13089 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:23.116420 13089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Generated new TSK 0
I20260812 09:50:23.117362 13089 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:23.159149 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36385
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:23.286720 13105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:23.287170 13105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:23.287252 13105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:23.291836 13105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:23.291911 13105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:23.291955 13105 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:23.291990 13105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:23.297931 13105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:36385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:23.299178 13105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:23.300261 13105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:23.311586 13116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:23.311586 13113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:23.311607 13112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:23.312255 13105 server_base.cc:1034] running on GCE node
I20260812 09:50:23.312796 13105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:23.313532 13105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:23.314750 13105 hybrid_clock.cc:648] HybridClock initialized: now 1786528223314731 us; error 37 us; skew 500 ppm
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:23.318194 13105 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:23.319307 13105 webserver.cc:460] Webserver started at http://127.11.118.129:42669/ using document root <none> and password file <none>
I20260812 09:50:23.319904 13105 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:23.320006 13105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:23.320246 13105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:23.322475 13105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "ac03892b4a06426c8c278a168fa4f84f"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "a90d220036dd03da807b415ab7a46a21"
server_key_iv: "57ae90b0d960f0cf34cf280649c68ff7"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.323197 13105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "ac03892b4a06426c8c278a168fa4f84f"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "a90d220036dd03da807b415ab7a46a21"
server_key_iv: "57ae90b0d960f0cf34cf280649c68ff7"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.327574 13105 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:50:23.330621 13124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.332038 13105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:23.332191 13105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "ac03892b4a06426c8c278a168fa4f84f"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "a90d220036dd03da807b415ab7a46a21"
server_key_iv: "57ae90b0d960f0cf34cf280649c68ff7"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.332322 13105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:23.352605 13105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:23.356074 13105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:23.356312 13105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:23.357883 13105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:23.357956 13105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.358022 13105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:23.358065 13105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:23.369576 13105 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:39435
I20260812 09:50:23.369921 13252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:39435 every 8 connection(s)
I20260812 09:50:23.370760 13105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:23.373277 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.358810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:43735 (local address 127.11.118.190:36385)
0812 09:50:23.359033 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.359038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.359863 (+ 825us) server_negotiation.cc:407] Connection header received
0812 09:50:23.360918 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.360924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.360993 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.361064 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.363003 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.363987 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.365515 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.365890 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.366016 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.369335 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.369339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.369342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.369376 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.371103 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.371795 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.371801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.371803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.371898 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.372263 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.372266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.372267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.372475 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.372559 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.373021 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.373144 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 09:50:23.374187 13136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.359232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.129:43735)
0812 09:50:23.359681 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.359733 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.360645 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.361555 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.361564 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.362024 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.362778 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.362802 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.364157 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.364160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.365377 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.365388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.366061 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.366066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.366260 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.366989 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.367007 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.369123 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.371256 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.371263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.371278 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.371676 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.371999 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.372005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.372009 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.372162 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.372568 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.372573 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.372800 (+ 227us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.372960 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.373224 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":123,"threads_started":1}
I20260812 09:50:23.375681 13253 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36385
I20260812 09:50:23.375865 13253 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:23.376487 13253 heartbeater.cc:511] Master 127.11.118.190:36385 requested a full tablet report, sending...
I20260812 09:50:23.377796 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13105
I20260812 09:50:23.377933 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:23.378235 11738 external_mini_cluster.cc:1428] Setting key 8327082a1cf729f0aa516b709d8e400b
I20260812 09:50:23.378228 13024 ts_manager.cc:194] Registered new tserver with Master: ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435)
I20260812 09:50:23.379897 13024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:43735
I20260812 09:50:23.387300 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.378101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:52115 (local address 127.11.118.190:36385)
0812 09:50:23.378215 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.378219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.378777 (+ 558us) server_negotiation.cc:407] Connection header received
0812 09:50:23.378904 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.378907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.378985 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.379068 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.379762 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.380532 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.381756 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.382068 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.382146 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.383842 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.383846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.383849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.383876 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.385429 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.385878 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.385881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.385882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.385957 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.386267 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.386269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.386270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.386466 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.386543 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.387038 (+ 495us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.387172 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":46}
I20260812 09:50:23.387405 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.378329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.129:52115)
0812 09:50:23.378670 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.378692 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.378821 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.379123 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.379127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.379374 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.379660 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.379668 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.380683 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.380687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.381607 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.381619 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.382314 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.382317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.382426 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.383118 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.383139 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.383681 (+ 542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.385559 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.385566 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.385571 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.385801 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.386036 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.386042 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.386047 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.386161 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.386572 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.386579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.386714 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.386854 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.387103 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:23.414525 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36385
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:23.531616 13265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:23.531913 13265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:23.531961 13265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:23.536434 13265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:23.536523 13265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:23.536588 13265 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:23.536654 13265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:23.542340 13265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:36385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:23.543660 13265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:23.544761 13265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:23.557936 13275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:23.557936 13271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:23.558542 13273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:23.558712 13265 server_base.cc:1034] running on GCE node
I20260812 09:50:23.559254 13265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:23.560039 13265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:23.561314 13265 hybrid_clock.cc:648] HybridClock initialized: now 1786528223561295 us; error 37 us; skew 500 ppm
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:23.564549 13265 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:23.565577 13265 webserver.cc:460] Webserver started at http://127.11.118.130:42587/ using document root <none> and password file <none>
I20260812 09:50:23.566224 13265 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:23.566339 13265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:23.566593 13265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:23.569079 13265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "c962ef14f8df4baf983b5c5ef12c8663"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "369d97831213f01e0cdf8bce5061b04d"
server_key_iv: "4908d125bb2dcd3cdfb22b14cc56185a"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.569754 13265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "c962ef14f8df4baf983b5c5ef12c8663"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "369d97831213f01e0cdf8bce5061b04d"
server_key_iv: "4908d125bb2dcd3cdfb22b14cc56185a"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.574141 13265 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:23.577260 13283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.578749 13265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 09:50:23.578907 13265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "c962ef14f8df4baf983b5c5ef12c8663"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "369d97831213f01e0cdf8bce5061b04d"
server_key_iv: "4908d125bb2dcd3cdfb22b14cc56185a"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.579092 13265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:23.594077 13265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:23.598208 13265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:23.598481 13265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:23.600279 13265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:23.600376 13265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.600466 13265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:23.600517 13265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:23.613219 13265 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:43493
I20260812 09:50:23.613320 13411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:43493 every 8 connection(s)
I20260812 09:50:23.614581 13265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:23.617940 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.601555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:41661 (local address 127.11.118.190:36385)
0812 09:50:23.601750 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.601756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.602737 (+ 981us) server_negotiation.cc:407] Connection header received
0812 09:50:23.604138 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.604142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.604209 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.604308 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.606071 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.607025 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.609227 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.609633 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.609736 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.612931 (+ 3195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.612936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.612940 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.612983 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.614901 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.615681 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.615685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.615686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.615811 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.616278 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.616283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.616285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.616604 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.616723 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.617491 (+ 768us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.617673 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 09:50:23.618871 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13265
I20260812 09:50:23.619029 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:23.619086 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.601989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.130:41661)
0812 09:50:23.602512 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.602571 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.603867 (+ 1296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.604512 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.604519 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.605000 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.605873 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.605902 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.607201 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.607207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.609051 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.609068 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.609842 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.609849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.610119 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.611060 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.611089 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.612663 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.615094 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.615102 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.615118 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.615529 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.615942 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.615945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.615947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.616141 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.616740 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.616748 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.617153 (+ 405us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.617393 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.617816 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":156,"threads_started":1}
I20260812 09:50:23.619372 11738 external_mini_cluster.cc:1428] Setting key 1cb7bda93839da3426f5a1e47a4b9a67
I20260812 09:50:23.622865 13413 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36385
I20260812 09:50:23.623075 13413 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:23.623682 13413 heartbeater.cc:511] Master 127.11.118.190:36385 requested a full tablet report, sending...
I20260812 09:50:23.624840 13024 ts_manager.cc:194] Registered new tserver with Master: c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130:43493)
I20260812 09:50:23.625497 13024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:41661
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:23.634522 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.623502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:48571 (local address 127.11.118.190:36385)
0812 09:50:23.623638 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.623643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.623842 (+ 199us) server_negotiation.cc:407] Connection header received
0812 09:50:23.624040 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.624043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.624096 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.624200 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.626025 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.627062 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.628284 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.628769 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.628925 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.630286 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.630292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.630297 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.630348 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.632331 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.632918 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.632921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.632922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.633014 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.633504 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.633507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.633519 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.633851 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.633954 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.634274 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.634400 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:50:23.634570 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.623419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.130:48571)
0812 09:50:23.623747 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.623765 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.623925 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.624218 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.624221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.624502 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.625870 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.625883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.627226 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.627230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.628135 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.628146 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.628968 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.628972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.629059 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.629676 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.629688 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.630080 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.632508 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.632511 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.632512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.632778 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.633175 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.633181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.633186 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.633327 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.633985 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.633987 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.634080 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.634171 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.634317 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":134,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:23.655886 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36385
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:23.784711 13424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:23.785050 13424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:23.785133 13424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:23.789568 13424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:23.789665 13424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:23.789734 13424 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:23.789795 13424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:23.795586 13424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:36385
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:23.796731 13424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:23.797762 13424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:23.808043 13432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:23.808393 13424 server_base.cc:1034] running on GCE node
W20260812 09:50:23.808207 13435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:23.808140 13429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:23.808964 13424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:23.809737 13424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:23.811034 13424 hybrid_clock.cc:648] HybridClock initialized: now 1786528223811006 us; error 56 us; skew 500 ppm
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:23.814193 13424 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:23.815225 13424 webserver.cc:460] Webserver started at http://127.11.118.131:45425/ using document root <none> and password file <none>
I20260812 09:50:23.815835 13424 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:23.815936 13424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:23.816181 13424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:23.818536 13424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "e52d40c97d681d07a8ff1212e4dbf8d6"
server_key_iv: "961943b88e1628299ca2df4b2b979139"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.819231 13424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "e52d40c97d681d07a8ff1212e4dbf8d6"
server_key_iv: "961943b88e1628299ca2df4b2b979139"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.823467 13424 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 09:50:23.826254 13442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.827790 13424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:23.827945 13424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e"
format_stamp: "Formatted at 2026-08-12 09:50:23 on dist-test-slave-2w3w"
server_key: "e52d40c97d681d07a8ff1212e4dbf8d6"
server_key_iv: "961943b88e1628299ca2df4b2b979139"
server_key_version: "encryptionkey@0"
I20260812 09:50:23.828075 13424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:23.839538 13424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:23.842774 13424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:23.843108 13424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:23.844707 13424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:23.844782 13424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:23.844856 13424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:23.844900 13424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:23.856642 13424 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:45381
I20260812 09:50:23.856707 13567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:45381 every 8 connection(s)
I20260812 09:50:23.857761 13424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:23.860013 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.845579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:46135 (local address 127.11.118.190:36385)
0812 09:50:23.845753 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.845758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.846732 (+ 974us) server_negotiation.cc:407] Connection header received
0812 09:50:23.848042 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.848045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.848108 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.848221 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.849483 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.850035 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.851293 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.851529 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.851645 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.855523 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.855527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.855530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.855569 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.857486 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.858239 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.858243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.858245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.858356 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.858815 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.858818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.858820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.859134 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.859226 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.859762 (+ 536us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.859884 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:50:23.860952 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.846050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.131:46135)
0812 09:50:23.846542 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.846597 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.847776 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.848401 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.848408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.848760 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.849305 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.849350 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.850176 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.850179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.851157 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.851167 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.851705 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.851709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.851916 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.852677 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.852704 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.855315 (+ 2611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.857630 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.857638 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.857655 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.858023 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.858486 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.858490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.858504 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.858676 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.859273 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.859278 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.859532 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.859692 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.859966 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":149,"threads_started":1}
I20260812 09:50:23.862347 13568 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36385
I20260812 09:50:23.862525 13568 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:23.863195 13568 heartbeater.cc:511] Master 127.11.118.190:36385 requested a full tablet report, sending...
I20260812 09:50:23.864295 13024 ts_manager.cc:194] Registered new tserver with Master: bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381)
I20260812 09:50:23.864936 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13424
I20260812 09:50:23.865069 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:23.865087 13024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:46135
I20260812 09:50:23.865366 11738 external_mini_cluster.cc:1428] Setting key cf076ae35742372d82d53838cef1d2fc
I20260812 09:50:23.867501 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:23.873824 13575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.864619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.11.118.131:53727)
0812 09:50:23.865837 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.865852 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.865976 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.866361 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.866364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.866619 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:23.866748 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.866755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.867835 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.867838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.868398 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.868405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.869072 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.869074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.869146 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.869720 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:23.869733 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:23.870085 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:23.872119 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.872122 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.872123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.872330 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.872685 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:23.872687 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:23.872688 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:23.872765 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:23.873272 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:23.873274 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:23.873373 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.873458 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.873578 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"thread_start_us":115,"threads_started":1}
I20260812 09:50:23.873931 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.864688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:53727 (local address 127.11.118.190:36385)
0812 09:50:23.864808 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.864812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.865934 (+ 1122us) server_negotiation.cc:407] Connection header received
0812 09:50:23.866099 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.866103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.866152 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.866238 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.866889 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.867667 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.868529 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.868948 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.869075 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.870234 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.870238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.870241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.870266 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.872007 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.872458 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.872464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.872469 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.872577 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.872860 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.872866 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.872871 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.873151 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.873263 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.873558 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.873732 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 09:50:23 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:23.899669 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.889608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38986 (local address 127.11.118.190:36385)
0812 09:50:23.889750 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.889753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.889766 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:50:23.889809 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.889812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.889852 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.889950 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:23.890701 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.891327 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.892355 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.892576 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.892661 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.895708 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:23.895711 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:23.895713 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:23.895745 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:23.897651 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.898173 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.898176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.898178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.898267 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:23.898616 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:23.898619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:23.898620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:23.898819 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:23.898923 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.899345 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.899461 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:50:23.903643 13024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:23.906906 13024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:23.923100 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.917200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:43493 (local address 127.0.0.1:45806)
0812 09:50:23.918035 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.918051 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.918142 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.918815 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.918818 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.918838 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:23.918919 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.918925 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.919989 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.919992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.921402 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.921412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.922515 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.922521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.922628 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.922665 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.922785 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.922884 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":778,"mutex_wait_us":114,"thread_start_us":106,"threads_started":1}
I20260812 09:50:23.923115 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.917737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45806 (local address 127.11.118.130:43493)
0812 09:50:23.918226 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.918240 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.918262 (+ 22us) server_negotiation.cc:407] Connection header received
0812 09:50:23.918333 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.918337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.918591 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.918845 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:23.919061 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.919862 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.921527 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.922373 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.922545 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.922687 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.922809 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.922911 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":145,"threads_started":1}
I20260812 09:50:23.923723 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.916271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45381 (local address 127.0.0.1:54132)
0812 09:50:23.917149 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.917222 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.917359 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.918192 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.918201 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.918231 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:23.918374 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.918384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.920007 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.920009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.921687 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.921700 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.923299 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.923304 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.923404 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.923435 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.923509 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.923579 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":303,"thread_start_us":86,"threads_started":1}
I20260812 09:50:23.923811 13590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.916381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54132 (local address 127.11.118.131:45381)
0812 09:50:23.917184 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.917198 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.917517 (+ 319us) server_negotiation.cc:407] Connection header received
0812 09:50:23.917606 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.917611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.917840 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.918005 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:23.918500 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.919848 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.921843 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.922376 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.922542 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.922686 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.923575 (+ 889us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.923677 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":135,"threads_started":1}
I20260812 09:50:23.926079 13342 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0330de016143dca515140d71be06cf (DEFAULT_TABLE table=test-table [id=c6836ec32b334bdcb0457e693eba773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:23.926081 13496 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0330de016143dca515140d71be06cf (DEFAULT_TABLE table=test-table [id=c6836ec32b334bdcb0457e693eba773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:23.927078 13589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.916339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:39435 (local address 127.0.0.1:39932)
0812 09:50:23.917576 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:23.917591 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:23.917758 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:23.918268 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:23.918271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:23.918288 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:23.918417 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.918424 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.919991 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.919997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.921721 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:23.921730 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.922992 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.922996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:23.923086 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.923113 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:50:23.926806 (+ 3693us) client_negotiation.cc:240] Negotiation successful
0812 09:50:23.926913 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1173,"mutex_wait_us":171,"thread_start_us":116,"threads_started":1}
I20260812 09:50:23.927223 13342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0330de016143dca515140d71be06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:23.927234 13496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0330de016143dca515140d71be06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:23.927423 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:23.916593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39932 (local address 127.11.118.129:39435)
0812 09:50:23.917396 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:23.917402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:23.917682 (+ 280us) server_negotiation.cc:407] Connection header received
0812 09:50:23.917956 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:23.917962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:23.918140 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:23.918282 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:23.918597 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.919838 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.921861 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:23.922642 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:23.922767 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:23.922892 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:23.926882 (+ 3990us) server_negotiation.cc:299] Negotiation successful
0812 09:50:23.927035 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":73,"threads_started":1}
I20260812 09:50:23.930430 13182 tablet_service.cc:1467] Processing CreateTablet for tablet 4e0330de016143dca515140d71be06cf (DEFAULT_TABLE table=test-table [id=c6836ec32b334bdcb0457e693eba773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:23.931847 13182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e0330de016143dca515140d71be06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:23.935104 13595 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Bootstrap starting.
I20260812 09:50:23.936733 13596 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Bootstrap starting.
I20260812 09:50:23.937762 13595 tablet_bootstrap.cc:654] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:23.938576 13595 log.cc:824] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:23.939137 13596 tablet_bootstrap.cc:654] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:23.940016 13596 log.cc:824] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:23.940308 13598 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Bootstrap starting.
I20260812 09:50:23.940968 13595 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: No bootstrap required, opened a new log
I20260812 09:50:23.941205 13595 ts_tablet_manager.cc:1397] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260812 09:50:23.942703 13598 tablet_bootstrap.cc:654] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:23.943624 13598 log.cc:824] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:23.945415 13595 raft_consensus.cc:348] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.945719 13595 raft_consensus.cc:374] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:23.945785 13595 raft_consensus.cc:729] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c962ef14f8df4baf983b5c5ef12c8663, State: Initialized, Role: FOLLOWER
I20260812 09:50:23.945983 13598 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: No bootstrap required, opened a new log
I20260812 09:50:23.946188 13598 ts_tablet_manager.cc:1397] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 09:50:23.946282 13595 consensus_queue.cc:260] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.947196 13413 heartbeater.cc:503] Master 127.11.118.190:36385 was elected leader, sending a full tablet report...
I20260812 09:50:23.947504 13595 ts_tablet_manager.cc:1428] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 09:50:23.949077 13596 tablet_bootstrap.cc:492] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: No bootstrap required, opened a new log
I20260812 09:50:23.949324 13596 ts_tablet_manager.cc:1397] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.004s
I20260812 09:50:23.951156 13598 raft_consensus.cc:348] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.951685 13598 raft_consensus.cc:374] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:23.951763 13598 raft_consensus.cc:729] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac03892b4a06426c8c278a168fa4f84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:23.952282 13598 consensus_queue.cc:260] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.952968 13253 heartbeater.cc:503] Master 127.11.118.190:36385 was elected leader, sending a full tablet report...
I20260812 09:50:23.953377 13598 ts_tablet_manager.cc:1428] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:50:23.953375 13596 raft_consensus.cc:348] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.953658 13596 raft_consensus.cc:374] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:23.953722 13596 raft_consensus.cc:729] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee24a38c5f94e5ea5d3b63d4f3d532e, State: Initialized, Role: FOLLOWER
I20260812 09:50:23.954183 13596 consensus_queue.cc:260] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:23.955096 13568 heartbeater.cc:503] Master 127.11.118.190:36385 was elected leader, sending a full tablet report...
I20260812 09:50:23.955279 13596 ts_tablet_manager.cc:1428] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260812 09:50:24.062556 13603 raft_consensus.cc:482] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:24.062870 13603 raft_consensus.cc:504] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:24.064177 13603 leader_election.cc:288] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381), ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435)
I20260812 09:50:24.068681 13590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.065059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:60165 (local address 127.11.118.131:45381)
0812 09:50:24.065264 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.065268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.065282 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:50:24.065333 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.065335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.065375 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.065491 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:24.065837 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.066398 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.067649 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.068072 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.068212 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.068273 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.068473 (+ 200us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.068555 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260812 09:50:24.068681 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.064610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45381 (local address 127.11.118.130:60165)
0812 09:50:24.064846 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.064862 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.064962 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.065516 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.065519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.065537 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:24.065690 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.065696 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.066519 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.066525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.067516 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.067527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.068204 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.068208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.068333 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.068353 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.068453 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.068531 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":2}
I20260812 09:50:24.069464 13607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.064610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:39435 (local address 127.11.118.130:58413)
0812 09:50:24.065138 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.065153 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.065297 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.065576 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.065579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.065595 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:24.066302 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.066311 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.067203 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.067207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.068167 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.068178 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.069017 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.069021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.069127 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.069145 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.069240 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.069311 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":65,"thread_start_us":217,"threads_started":1}
I20260812 09:50:24.069460 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.064694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58413 (local address 127.11.118.129:39435)
0812 09:50:24.064904 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.064911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.065259 (+ 348us) server_negotiation.cc:407] Connection header received
0812 09:50:24.065425 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.065432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.065475 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.065564 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:24.066448 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.066954 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.068331 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.068831 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.068978 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.069036 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.069262 (+ 226us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.069342 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 09:50:24.069491 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0330de016143dca515140d71be06cf" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" is_pre_election: true
I20260812 09:50:24.069882 13517 raft_consensus.cc:2454] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 0.
I20260812 09:50:24.070166 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0330de016143dca515140d71be06cf" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f" is_pre_election: true
I20260812 09:50:24.070475 13205 raft_consensus.cc:2454] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 0.
I20260812 09:50:24.070462 13286 leader_election.cc:302] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee24a38c5f94e5ea5d3b63d4f3d532e, c962ef14f8df4baf983b5c5ef12c8663; no voters:
I20260812 09:50:24.070932 13603 raft_consensus.cc:2781] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:24.071069 13603 raft_consensus.cc:482] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:24.071125 13603 raft_consensus.cc:3037] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.072238 13603 raft_consensus.cc:504] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:24.072597 13603 leader_election.cc:288] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 election: Requested vote from peers bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381), ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435)
I20260812 09:50:24.073012 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0330de016143dca515140d71be06cf" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f"
I20260812 09:50:24.073021 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e0330de016143dca515140d71be06cf" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e"
I20260812 09:50:24.073302 13205 raft_consensus.cc:3037] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.073376 13517 raft_consensus.cc:3037] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.074712 13205 raft_consensus.cc:2454] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 1.
I20260812 09:50:24.075129 13284 leader_election.cc:302] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac03892b4a06426c8c278a168fa4f84f, c962ef14f8df4baf983b5c5ef12c8663; no voters:
I20260812 09:50:24.075372 13603 raft_consensus.cc:2781] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:24.075470 13517 raft_consensus.cc:2454] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 1.
I20260812 09:50:24.075639 13603 raft_consensus.cc:686] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 1 LEADER]: Becoming Leader. State: Replica: c962ef14f8df4baf983b5c5ef12c8663, State: Running, Role: LEADER
I20260812 09:50:24.076025 13603 consensus_queue.cc:237] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } }
I20260812 09:50:24.079689 13025 catalog_manager.cc:5495] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 reported cstate change: term changed from 0 to 1, leader changed from <none> to c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "c962ef14f8df4baf983b5c5ef12c8663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } health_report { overall_health: HEALTHY } } }
W20260812 09:50:24.108964 13570 tablet.cc:2369] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:24.116122 13414 tablet.cc:2369] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:24.122310 13254 tablet.cc:2369] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:24.128808 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.124544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45810 (local address 127.11.118.130:43493)
0812 09:50:24.124704 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.124708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.124726 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:24.124926 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.124929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.124989 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.125091 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:24.125341 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.125939 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.126858 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.127218 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.127311 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.127802 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.128326 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.128429 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.128580 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.128640 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:50:24.136837 13517 raft_consensus.cc:1261] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Refusing update from remote peer c962ef14f8df4baf983b5c5ef12c8663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.137382 13205 raft_consensus.cc:1261] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Refusing update from remote peer c962ef14f8df4baf983b5c5ef12c8663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.137842 13608 consensus_queue.cc:1035] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.138092 13603 consensus_queue.cc:1035] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.145941 13613 mvcc.cc:205] Tried to move back new op lower bound from 7317619606052081664 to 7317619605818769408. Current Snapshot: MvccSnapshot[applied={T|T < 7317619606052081664}]
I20260812 09:50:24.148155 13614 mvcc.cc:205] Tried to move back new op lower bound from 7317619606052081664 to 7317619605818769408. Current Snapshot: MvccSnapshot[applied={T|T < 7317619606052081664}]
I20260812 09:50:24.148398 13616 mvcc.cc:205] Tried to move back new op lower bound from 7317619606052081664 to 7317619605818769408. Current Snapshot: MvccSnapshot[applied={T|T < 7317619606052081664}]
I20260812 09:50:24.163035 13024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:24.163303 13024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:24.166848 13024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Sending DeleteTablet for 3 replicas of tablet 4e0330de016143dca515140d71be06cf
I20260812 09:50:24.168066 13496 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0330de016143dca515140d71be06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:54132
I20260812 09:50:24.168147 13342 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0330de016143dca515140d71be06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45806
I20260812 09:50:24.168622 13182 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e0330de016143dca515140d71be06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:39932
I20260812 09:50:24.168926 13624 tablet_replica.cc:330] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: stopping tablet replica
I20260812 09:50:24.169248 13624 raft_consensus.cc:2229] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:24.169572 13624 raft_consensus.cc:2258] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:24.170001 13625 tablet_replica.cc:330] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: stopping tablet replica
I20260812 09:50:24.170260 13625 raft_consensus.cc:2229] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:24.170503 13625 raft_consensus.cc:2258] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:24.171064 13626 tablet_replica.cc:330] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: stopping tablet replica
I20260812 09:50:24.171415 13626 raft_consensus.cc:2229] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:24.171301 13024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 09:50:24.171718 13626 raft_consensus.cc:2258] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 09:50:24.172227 13024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:24.172541 13625 ts_tablet_manager.cc:1905] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.173246 13624 ts_tablet_manager.cc:1905] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.173360 13626 ts_tablet_manager.cc:1905] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.177690 13626 ts_tablet_manager.cc:1918] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:24.177707 13624 ts_tablet_manager.cc:1918] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:24.177831 13624 log.cc:1196] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/4e0330de016143dca515140d71be06cf
I20260812 09:50:24.177834 13626 log.cc:1196] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/4e0330de016143dca515140d71be06cf
I20260812 09:50:24.178205 13624 ts_tablet_manager.cc:1939] T 4e0330de016143dca515140d71be06cf P c962ef14f8df4baf983b5c5ef12c8663: Deleting consensus metadata
I20260812 09:50:24.178248 13626 ts_tablet_manager.cc:1939] T 4e0330de016143dca515140d71be06cf P ac03892b4a06426c8c278a168fa4f84f: Deleting consensus metadata
I20260812 09:50:24.179114 13342 tablet_service.cc:1467] Processing CreateTablet for tablet ba8d172e475f4e49ab6dc388cb179696 (DEFAULT_TABLE table=test-table [id=92a893ba59e4449fa492f439fa38dbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:24.179191 13182 tablet_service.cc:1467] Processing CreateTablet for tablet ba8d172e475f4e49ab6dc388cb179696 (DEFAULT_TABLE table=test-table [id=92a893ba59e4449fa492f439fa38dbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:24.179253 13496 tablet_service.cc:1467] Processing CreateTablet for tablet ba8d172e475f4e49ab6dc388cb179696 (DEFAULT_TABLE table=test-table [id=92a893ba59e4449fa492f439fa38dbd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:24.179432 13342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8d172e475f4e49ab6dc388cb179696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.179487 13182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8d172e475f4e49ab6dc388cb179696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.179531 13496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8d172e475f4e49ab6dc388cb179696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.182294 13595 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Bootstrap starting.
I20260812 09:50:24.182624 13598 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Bootstrap starting.
I20260812 09:50:24.184217 13595 tablet_bootstrap.cc:654] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.184724 13598 tablet_bootstrap.cc:654] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.184834 13596 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Bootstrap starting.
I20260812 09:50:24.186268 13006 catalog_manager.cc:4841] TS ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435): tablet 4e0330de016143dca515140d71be06cf (table test-table [id=c6836ec32b334bdcb0457e693eba773f]) successfully deleted
I20260812 09:50:24.186844 13596 tablet_bootstrap.cc:654] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.188289 13008 catalog_manager.cc:4841] TS c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130:43493): tablet 4e0330de016143dca515140d71be06cf (table test-table [id=c6836ec32b334bdcb0457e693eba773f]) successfully deleted
I20260812 09:50:24.190122 13595 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: No bootstrap required, opened a new log
I20260812 09:50:24.190240 13595 ts_tablet_manager.cc:1397] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20260812 09:50:24.190987 13595 raft_consensus.cc:348] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.191147 13595 raft_consensus.cc:374] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.191183 13595 raft_consensus.cc:729] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c962ef14f8df4baf983b5c5ef12c8663, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.191736 13596 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: No bootstrap required, opened a new log
I20260812 09:50:24.191869 13596 ts_tablet_manager.cc:1397] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260812 09:50:24.192353 13625 ts_tablet_manager.cc:1918] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:24.192473 13625 log.cc:1196] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/4e0330de016143dca515140d71be06cf
I20260812 09:50:24.192605 13596 raft_consensus.cc:348] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.192726 13596 raft_consensus.cc:374] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.192764 13596 raft_consensus.cc:729] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee24a38c5f94e5ea5d3b63d4f3d532e, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.192873 13625 ts_tablet_manager.cc:1939] T 4e0330de016143dca515140d71be06cf P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting consensus metadata
I20260812 09:50:24.192931 13596 consensus_queue.cc:260] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.193325 13595 consensus_queue.cc:260] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.193809 13595 ts_tablet_manager.cc:1428] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 09:50:24.194530 13596 ts_tablet_manager.cc:1428] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:24.195690 13598 tablet_bootstrap.cc:492] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: No bootstrap required, opened a new log
I20260812 09:50:24.195799 13598 ts_tablet_manager.cc:1397] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260812 09:50:24.196604 13007 catalog_manager.cc:4841] TS bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381): tablet 4e0330de016143dca515140d71be06cf (table test-table [id=c6836ec32b334bdcb0457e693eba773f]) successfully deleted
I20260812 09:50:24.196910 13598 raft_consensus.cc:348] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.197057 13598 raft_consensus.cc:374] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.197094 13598 raft_consensus.cc:729] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac03892b4a06426c8c278a168fa4f84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.197238 13598 consensus_queue.cc:260] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.197619 13598 ts_tablet_manager.cc:1428] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:24.463172 13620 raft_consensus.cc:482] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:24.463337 13620 raft_consensus.cc:504] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.464103 13620 leader_election.cc:288] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435), bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381)
I20260812 09:50:24.464756 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8d172e475f4e49ab6dc388cb179696" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f" is_pre_election: true
I20260812 09:50:24.464947 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8d172e475f4e49ab6dc388cb179696" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" is_pre_election: true
I20260812 09:50:24.465000 13205 raft_consensus.cc:2454] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 0.
I20260812 09:50:24.465106 13517 raft_consensus.cc:2454] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 0.
I20260812 09:50:24.465417 13284 leader_election.cc:302] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac03892b4a06426c8c278a168fa4f84f, c962ef14f8df4baf983b5c5ef12c8663; no voters:
I20260812 09:50:24.465643 13620 raft_consensus.cc:2781] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:24.465711 13620 raft_consensus.cc:482] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:24.465739 13620 raft_consensus.cc:3037] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.466897 13620 raft_consensus.cc:504] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.467350 13620 leader_election.cc:288] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 election: Requested vote from peers ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435), bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381)
I20260812 09:50:24.467839 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8d172e475f4e49ab6dc388cb179696" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e"
I20260812 09:50:24.467871 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8d172e475f4e49ab6dc388cb179696" candidate_uuid: "c962ef14f8df4baf983b5c5ef12c8663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f"
I20260812 09:50:24.468001 13205 raft_consensus.cc:3037] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.468001 13517 raft_consensus.cc:3037] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.469570 13205 raft_consensus.cc:2454] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 1.
I20260812 09:50:24.469570 13517 raft_consensus.cc:2454] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c962ef14f8df4baf983b5c5ef12c8663 in term 1.
I20260812 09:50:24.469936 13286 leader_election.cc:302] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee24a38c5f94e5ea5d3b63d4f3d532e, c962ef14f8df4baf983b5c5ef12c8663; no voters:
I20260812 09:50:24.470153 13620 raft_consensus.cc:2781] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:24.470271 13620 raft_consensus.cc:686] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 1 LEADER]: Becoming Leader. State: Replica: c962ef14f8df4baf983b5c5ef12c8663, State: Running, Role: LEADER
I20260812 09:50:24.470430 13620 consensus_queue.cc:237] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.472347 13024 catalog_manager.cc:5495] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 reported cstate change: term changed from 0 to 1, leader changed from <none> to c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "c962ef14f8df4baf983b5c5ef12c8663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } health_report { overall_health: UNKNOWN } } }
Aug 12 09:50:24 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:24.539701 13636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.528935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38994 (local address 127.11.118.190:36385)
0812 09:50:24.529295 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.529304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.529410 (+ 106us) server_negotiation.cc:407] Connection header received
0812 09:50:24.529580 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.529583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.529627 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.529726 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:24.530425 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.531131 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.531989 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.532211 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.532324 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.535295 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:24.535298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:24.535300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:24.535344 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:24.537267 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.537799 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.537804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.537808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.537898 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.538182 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.538188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.538190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.538434 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:24.538740 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.539116 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.539369 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":175,"server-negotiator.queue_time_us":307,"thread_start_us":122,"threads_started":1}
I20260812 09:50:24.539702 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.528914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36385 (local address 127.0.0.1:38994)
0812 09:50:24.529298 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.529314 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.529469 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.529742 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.529745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.530198 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:24.530291 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.530297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.531246 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.531249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.531864 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.531873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.532328 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.532421 (+ 93us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.532555 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.533284 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:24.533299 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:24.535131 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:24.537405 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:24.537419 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:24.537428 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:24.537687 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:24.537999 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:24.538002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:24.538004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:24.538092 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:24.538739 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:24.538747 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:24.538888 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.539065 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.539314 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":9,"thread_start_us":121,"threads_started":1}
I20260812 09:50:24.545090 13024 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:38994:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 09:50:24.545903 13024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:24.551661 13342 tablet_service.cc:1467] Processing CreateTablet for tablet 566368bf716645dbba4825513ce1597b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90f01b96b8d84e1ea19d7fd2c8a6054f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:24.551702 13182 tablet_service.cc:1467] Processing CreateTablet for tablet 566368bf716645dbba4825513ce1597b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90f01b96b8d84e1ea19d7fd2c8a6054f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:24.551744 13496 tablet_service.cc:1467] Processing CreateTablet for tablet 566368bf716645dbba4825513ce1597b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90f01b96b8d84e1ea19d7fd2c8a6054f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:24.552129 13342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566368bf716645dbba4825513ce1597b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.552167 13496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566368bf716645dbba4825513ce1597b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.552167 13182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 566368bf716645dbba4825513ce1597b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:24.555094 13595 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: Bootstrap starting.
I20260812 09:50:24.555804 13596 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: Bootstrap starting.
I20260812 09:50:24.555804 13598 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: Bootstrap starting.
I20260812 09:50:24.556298 13595 tablet_bootstrap.cc:654] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.557432 13598 tablet_bootstrap.cc:654] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.557456 13596 tablet_bootstrap.cc:654] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:24.557848 13595 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: No bootstrap required, opened a new log
I20260812 09:50:24.557971 13595 ts_tablet_manager.cc:1397] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 09:50:24.558434 13595 raft_consensus.cc:348] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.558583 13595 raft_consensus.cc:374] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.558620 13595 raft_consensus.cc:729] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c962ef14f8df4baf983b5c5ef12c8663, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.558780 13595 consensus_queue.cc:260] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.559104 13595 ts_tablet_manager.cc:1428] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260812 09:50:24.559139 13620 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.559348 13620 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.560199 13598 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: No bootstrap required, opened a new log
I20260812 09:50:24.560254 13596 tablet_bootstrap.cc:492] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: No bootstrap required, opened a new log
I20260812 09:50:24.560304 13598 ts_tablet_manager.cc:1397] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260812 09:50:24.560343 13596 ts_tablet_manager.cc:1397] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 09:50:24.560940 13598 raft_consensus.cc:348] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.561036 13598 raft_consensus.cc:374] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.561059 13598 raft_consensus.cc:729] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac03892b4a06426c8c278a168fa4f84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.561156 13596 raft_consensus.cc:348] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.561291 13596 raft_consensus.cc:374] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:24.561213 13598 consensus_queue.cc:260] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.561322 13596 raft_consensus.cc:729] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee24a38c5f94e5ea5d3b63d4f3d532e, State: Initialized, Role: FOLLOWER
I20260812 09:50:24.561474 13596 consensus_queue.cc:260] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.561699 13598 ts_tablet_manager.cc:1428] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260812 09:50:24.561748 13606 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.561972 13606 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.562017 13604 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.562206 13604 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.562248 13596 ts_tablet_manager.cc:1428] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 09:50:24.623972 13606 raft_consensus.cc:482] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:24.624147 13606 raft_consensus.cc:504] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.625442 13606 leader_election.cc:288] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435), c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130:43493)
I20260812 09:50:24.631544 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.625898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:44103 (local address 127.11.118.130:43493)
0812 09:50:24.626031 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.626036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.626604 (+ 568us) server_negotiation.cc:407] Connection header received
0812 09:50:24.626706 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.626709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.626757 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.626833 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:24.627665 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.628602 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.629885 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.630514 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.630646 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.630702 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.631278 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.631403 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:50:24.632309 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.625765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:43493 (local address 127.11.118.131:44103)
0812 09:50:24.626491 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.626505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.626616 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.626863 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.626865 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.626907 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:24.627510 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.627517 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.628757 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.628760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.629732 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.629764 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.630682 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.630687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.630884 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.630916 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.631837 (+ 921us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.631979 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"mutex_wait_us":38,"spinlock_wait_cycles":4864,"thread_start_us":76,"threads_started":1}
I20260812 09:50:24.633136 13363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566368bf716645dbba4825513ce1597b" candidate_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c962ef14f8df4baf983b5c5ef12c8663" is_pre_election: true
I20260812 09:50:24.633412 13363 raft_consensus.cc:2454] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee24a38c5f94e5ea5d3b63d4f3d532e in term 0.
I20260812 09:50:24.633620 13641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.625650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:39435 (local address 127.11.118.131:51163)
0812 09:50:24.626117 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.626130 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.626221 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.626861 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.626864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.626900 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:24.627497 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.627511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.629814 (+ 2303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.629820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.631653 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.631665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.632978 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.632982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.633200 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.633229 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.633337 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.633413 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":18,"spinlock_wait_cycles":7296,"thread_start_us":80,"threads_started":1}
I20260812 09:50:24.634076 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.626148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:51163 (local address 127.11.118.129:39435)
0812 09:50:24.626484 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.626487 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.626500 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:50:24.626548 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.626550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.626623 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.626715 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:24.628780 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.629679 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.631845 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.632839 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.632996 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.633051 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.633807 (+ 756us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.633908 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":151,"threads_started":1}
I20260812 09:50:24.634059 13445 leader_election.cc:302] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bee24a38c5f94e5ea5d3b63d4f3d532e, c962ef14f8df4baf983b5c5ef12c8663; no voters:
I20260812 09:50:24.634372 13606 raft_consensus.cc:2781] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:24.634454 13606 raft_consensus.cc:482] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:24.634505 13606 raft_consensus.cc:3037] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.634702 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566368bf716645dbba4825513ce1597b" candidate_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f" is_pre_election: true
I20260812 09:50:24.634846 13205 raft_consensus.cc:2454] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee24a38c5f94e5ea5d3b63d4f3d532e in term 0.
I20260812 09:50:24.636078 13606 raft_consensus.cc:504] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.636502 13606 leader_election.cc:288] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [CANDIDATE]: Term 1 election: Requested vote from peers ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435), c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130:43493)
I20260812 09:50:24.636952 13363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566368bf716645dbba4825513ce1597b" candidate_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c962ef14f8df4baf983b5c5ef12c8663"
I20260812 09:50:24.637045 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "566368bf716645dbba4825513ce1597b" candidate_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac03892b4a06426c8c278a168fa4f84f"
I20260812 09:50:24.637115 13363 raft_consensus.cc:3037] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.637163 13205 raft_consensus.cc:3037] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:24.638621 13205 raft_consensus.cc:2454] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee24a38c5f94e5ea5d3b63d4f3d532e in term 1.
I20260812 09:50:24.638634 13363 raft_consensus.cc:2454] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee24a38c5f94e5ea5d3b63d4f3d532e in term 1.
I20260812 09:50:24.638947 13443 leader_election.cc:302] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac03892b4a06426c8c278a168fa4f84f, bee24a38c5f94e5ea5d3b63d4f3d532e; no voters:
I20260812 09:50:24.639192 13606 raft_consensus.cc:2781] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:24.639467 13606 raft_consensus.cc:686] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 LEADER]: Becoming Leader. State: Replica: bee24a38c5f94e5ea5d3b63d4f3d532e, State: Running, Role: LEADER
I20260812 09:50:24.639755 13606 consensus_queue.cc:237] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } }
I20260812 09:50:24.641332 13645 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: TxnStatusTablet state changed. Reason: New leader bee24a38c5f94e5ea5d3b63d4f3d532e. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.641458 13645 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:24.641860 13647 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 09:50:24.642081 13647 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 09:50:24.642899 13022 catalog_manager.cc:5495] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e reported cstate change: term changed from 0 to 1, leader changed from <none> to bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131). New cstate: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260812 09:50:24.671279 13650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.666367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54142 (local address 127.11.118.131:45381)
0812 09:50:24.666698 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.666701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.666716 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:24.666792 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.666794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.666850 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.667205 (+ 355us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:24.667329 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.668074 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.669387 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.669691 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.669780 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.670259 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.670719 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.670812 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.671024 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.671092 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
I20260812 09:50:24.671271 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.666232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45381 (local address 127.0.0.1:54142)
0812 09:50:24.666467 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.666497 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.666631 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.667082 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.667085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.667094 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:24.667222 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.667229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.668201 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.668205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.669240 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.669252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.669811 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.669815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.669911 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.670050 (+ 139us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.670826 (+ 776us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.670845 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.670927 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.671057 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 09:50:24.674590 13205 raft_consensus.cc:1261] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Refusing update from remote peer bee24a38c5f94e5ea5d3b63d4f3d532e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.674932 13363 raft_consensus.cc:1261] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Refusing update from remote peer bee24a38c5f94e5ea5d3b63d4f3d532e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.675274 13606 consensus_queue.cc:1035] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.675719 13645 consensus_queue.cc:1035] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.677316 13604 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: TxnStatusTablet state changed. Reason: New leader bee24a38c5f94e5ea5d3b63d4f3d532e. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.677462 13604 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.679298 13620 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: TxnStatusTablet state changed. Reason: New leader bee24a38c5f94e5ea5d3b63d4f3d532e. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.679473 13620 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.680994 13645 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.681156 13645 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:24.681319 13645 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.681417 13645 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P bee24a38c5f94e5ea5d3b63d4f3d532e: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:24.681492 13604 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.681617 13604 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P ac03892b4a06426c8c278a168fa4f84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.682776 13620 tablet_replica.cc:439] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 } } peers { permanent_uuid: "c962ef14f8df4baf983b5c5ef12c8663" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 43493 } } peers { permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 } } }
I20260812 09:50:24.682915 13620 tablet_replica.cc:442] T 566368bf716645dbba4825513ce1597b P c962ef14f8df4baf983b5c5ef12c8663: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:24.705015 13650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.700608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:45389 (local address 127.11.118.131:45381)
0812 09:50:24.700746 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.700749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.701032 (+ 283us) server_negotiation.cc:407] Connection header received
0812 09:50:24.701179 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.701182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.701228 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.701295 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:24.701652 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.702158 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.703607 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.703851 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.703952 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.704494 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.704579 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.704648 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.704838 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.704896 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 09:50:24.705114 13664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.700515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45381 (local address 127.11.118.130:45389)
0812 09:50:24.700938 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.700955 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.701078 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.701399 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.701402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.701411 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:24.701533 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.701540 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.702284 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.702288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.703454 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.703467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.704021 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.704026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.704156 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.704237 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.704690 (+ 453us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.704702 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.704778 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.704915 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":89,"threads_started":1}
I20260812 09:50:24.713307 13205 raft_consensus.cc:1261] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Refusing update from remote peer c962ef14f8df4baf983b5c5ef12c8663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.713307 13517 raft_consensus.cc:1261] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Refusing update from remote peer c962ef14f8df4baf983b5c5ef12c8663: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:24.713997 13603 consensus_queue.cc:1035] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee24a38c5f94e5ea5d3b63d4f3d532e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.714178 13620 consensus_queue.cc:1035] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac03892b4a06426c8c278a168fa4f84f" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 39435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:24.745311 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.739293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:40611 (local address 127.11.118.130:43493)
0812 09:50:24.739439 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.739445 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.739939 (+ 494us) server_negotiation.cc:407] Connection header received
0812 09:50:24.740057 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.740060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.740124 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.740226 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:24.740721 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.741552 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.743513 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.743871 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.743950 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.744702 (+ 752us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.744788 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.744904 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.745131 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.745195 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 09:50:24.745644 13671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.739178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:43493 (local address 127.11.118.131:40611)
0812 09:50:24.739817 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:24.739833 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:24.739959 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:24.740245 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:24.740248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:24.740256 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:24.740575 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.740583 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.741717 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.741720 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.743331 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:24.743356 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.744283 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.744288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:24.744441 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.744510 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:24.744968 (+ 458us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:24.744986 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:50:24.745068 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 09:50:24.745169 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":184,"threads_started":1}
I20260812 09:50:24.774255 13024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:24.774483 13024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:24.777050 13024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa0d3ea9eccd4365a85356e0a09e746a: Sending DeleteTablet for 3 replicas of tablet ba8d172e475f4e49ab6dc388cb179696
I20260812 09:50:24.777705 13342 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8d172e475f4e49ab6dc388cb179696 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45806
I20260812 09:50:24.777849 13182 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8d172e475f4e49ab6dc388cb179696 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:39932
I20260812 09:50:24.778223 13496 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8d172e475f4e49ab6dc388cb179696 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:24 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:54132
I20260812 09:50:24.778312 13674 tablet_replica.cc:330] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: stopping tablet replica
I20260812 09:50:24.778470 13674 raft_consensus.cc:2229] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:24.778614 13674 raft_consensus.cc:2258] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:24.778985 13673 tablet_replica.cc:330] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: stopping tablet replica
I20260812 09:50:24.779170 13673 raft_consensus.cc:2229] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:24.779410 13673 raft_consensus.cc:2258] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:24.779702 13674 ts_tablet_manager.cc:1905] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.780072 13673 ts_tablet_manager.cc:1905] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.780359 13675 tablet_replica.cc:330] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: stopping tablet replica
I20260812 09:50:24.780525 13675 raft_consensus.cc:2229] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:24.780646 13675 raft_consensus.cc:2258] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:24.781329 13675 ts_tablet_manager.cc:1905] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:24.783777 13674 ts_tablet_manager.cc:1918] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:24.783878 13673 ts_tablet_manager.cc:1918] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:24.783968 13673 log.cc:1196] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/ba8d172e475f4e49ab6dc388cb179696
I20260812 09:50:24.784097 13674 log.cc:1196] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/ba8d172e475f4e49ab6dc388cb179696
I20260812 09:50:24.784300 13673 ts_tablet_manager.cc:1939] T ba8d172e475f4e49ab6dc388cb179696 P c962ef14f8df4baf983b5c5ef12c8663: Deleting consensus metadata
I20260812 09:50:24.784461 13675 ts_tablet_manager.cc:1918] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:24.784554 13675 log.cc:1196] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/ba8d172e475f4e49ab6dc388cb179696
I20260812 09:50:24.784644 13674 ts_tablet_manager.cc:1939] T ba8d172e475f4e49ab6dc388cb179696 P ac03892b4a06426c8c278a168fa4f84f: Deleting consensus metadata
I20260812 09:50:24.784829 13675 ts_tablet_manager.cc:1939] T ba8d172e475f4e49ab6dc388cb179696 P bee24a38c5f94e5ea5d3b63d4f3d532e: Deleting consensus metadata
I20260812 09:50:24.785316 13008 catalog_manager.cc:4841] TS c962ef14f8df4baf983b5c5ef12c8663 (127.11.118.130:43493): tablet ba8d172e475f4e49ab6dc388cb179696 (table test-table [id=92a893ba59e4449fa492f439fa38dbd0]) successfully deleted
I20260812 09:50:24.785660 13006 catalog_manager.cc:4841] TS ac03892b4a06426c8c278a168fa4f84f (127.11.118.129:39435): tablet ba8d172e475f4e49ab6dc388cb179696 (table test-table [id=92a893ba59e4449fa492f439fa38dbd0]) successfully deleted
I20260812 09:50:24.786401 13007 catalog_manager.cc:4841] TS bee24a38c5f94e5ea5d3b63d4f3d532e (127.11.118.131:45381): tablet ba8d172e475f4e49ab6dc388cb179696 (table test-table [id=92a893ba59e4449fa492f439fa38dbd0]) successfully deleted
Aug 12 09:50:24 dist-test-slave-2w3w krb5kdc[12972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528223, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:24.797026 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.785541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39940 (local address 127.11.118.129:39435)
0812 09:50:24.785652 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.785659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.786126 (+ 467us) server_negotiation.cc:407] Connection header received
0812 09:50:24.786302 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.786305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.786357 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.786447 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:24.787221 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.787834 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.788772 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.789008 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.789249 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.792585 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:24.792602 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:24.792621 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:24.792655 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:24.794798 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.795561 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.795573 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.795574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.795664 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.795975 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.795979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.795981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.796290 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:24.796530 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.796706 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.796846 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260812 09:50:24.797676 13246 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39940
I20260812 09:50:24.810592 13636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:24.800125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.11.118.190:36385)
0812 09:50:24.800285 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:24.800290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:24.800435 (+ 145us) server_negotiation.cc:407] Connection header received
0812 09:50:24.800586 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:24.800589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:24.800633 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:24.800700 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:24.801840 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.802427 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.804010 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:24.804266 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:24.804362 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:24.806509 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:24.806512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:24.806514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:24.806542 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:24.808308 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.808944 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.808947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.808949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.809060 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:24.809445 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:24.809447 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:24.809449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:24.809658 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:24.809785 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:24.810238 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 09:50:24.810364 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 09:50:24.811163 13024 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39006
I20260812 09:50:24.812776 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13105
I20260812 09:50:24.825847 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13265
I20260812 09:50:24.839147 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13424
I20260812 09:50:24.850741 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 12989
2026-08-12T09:50:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3293 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:24 dist-test-slave-2w3w krb5kdc[13682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:24 dist-test-slave-2w3w krb5kdc[13682](info): set up 2 sockets
Aug 12 09:50:24 dist-test-slave-2w3w krb5kdc[13682](info): commencing operation
krb5kdc: starting...
W20260812 09:50:25.993317 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:26.134670 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33685
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:33685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:26.253532 13699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:26.253827 13699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:26.253870 13699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:26.258148 13699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:26.258222 13699 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 09:50:26.258240 13699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:26.258260 13699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:26.258276 13699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:26.258330 13699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:26.264055 13699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:33685
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:26.265282 13699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:26.266422 13699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:26.275490 13704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.275511 13707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.275506 13705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:26.275933 13699 server_base.cc:1034] running on GCE node
I20260812 09:50:26.276635 13699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:26.277855 13699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:26.279080 13699 hybrid_clock.cc:648] HybridClock initialized: now 1786528226279052 us; error 35 us; skew 500 ppm
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:26.282356 13699 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:26.283439 13699 webserver.cc:460] Webserver started at http://127.11.118.190:37347/ using document root <none> and password file <none>
I20260812 09:50:26.284032 13699 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:26.284111 13699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:26.284301 13699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:26.286626 13699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "2eb9c4ce62f9481d87e7fcbf630e1590"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "3393aae66a192877401a7e2abac5a30f"
server_key_iv: "406c1fe3f4d73123949682c543a262cb"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.287340 13699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "2eb9c4ce62f9481d87e7fcbf630e1590"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "3393aae66a192877401a7e2abac5a30f"
server_key_iv: "406c1fe3f4d73123949682c543a262cb"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.291715 13699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:26.294447 13714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:26.295970 13699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:26.296118 13699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "2eb9c4ce62f9481d87e7fcbf630e1590"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "3393aae66a192877401a7e2abac5a30f"
server_key_iv: "406c1fe3f4d73123949682c543a262cb"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.296247 13699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:26.312755 13699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:26.316277 13699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:26.316501 13699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:26.325223 13699 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:33685
I20260812 09:50:26.325284 13784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:33685 every 8 connection(s)
I20260812 09:50:26.326303 13699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:26.329195 13785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:26.332772 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13699
I20260812 09:50:26.332944 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:26.333209 11738 external_mini_cluster.cc:1428] Setting key 19b980cc4033025d6a30540090ef8925
I20260812 09:50:26.335691 13785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Bootstrap starting.
I20260812 09:50:26.338589 13785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:26.339526 13785 log.cc:824] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:26.341902 13785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: No bootstrap required, opened a new log
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:26.346930 13785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } }
I20260812 09:50:26.347306 13785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:26.347378 13785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eb9c4ce62f9481d87e7fcbf630e1590, State: Initialized, Role: FOLLOWER
I20260812 09:50:26.347900 13785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } }
I20260812 09:50:26.348062 13785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:26.348186 13785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:26.348297 13785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:26.349625 13785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } }
I20260812 09:50:26.349742 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.334756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.11.118.190:33685)
0812 09:50:26.335265 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:26.335285 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:26.335329 (+ 44us) server_negotiation.cc:407] Connection header received
0812 09:50:26.336178 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:26.336203 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:26.336632 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:26.337028 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:26.337730 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.339303 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.340243 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.340786 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.340923 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.343975 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:26.343982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:26.344001 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:26.344034 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:26.346108 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.346588 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.346594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.346600 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.346744 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.347066 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.347070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.347071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.347635 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:26.347853 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:26.348293 (+ 440us) server_negotiation.cc:299] Negotiation successful
0812 09:50:26.348667 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":181,"threads_started":1}
I20260812 09:50:26.350021 13785 leader_election.cc:302] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2eb9c4ce62f9481d87e7fcbf630e1590; no voters:
I20260812 09:50:26.350416 13785 leader_election.cc:288] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:26.350546 13790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:26.350800 13790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [term 1 LEADER]: Becoming Leader. State: Replica: 2eb9c4ce62f9481d87e7fcbf630e1590, State: Running, Role: LEADER
I20260812 09:50:26.351238 13790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } }
I20260812 09:50:26.351831 13785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:26.352934 13791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } } }
I20260812 09:50:26.353080 13791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:26.353506 13800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:26.353565 13792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2eb9c4ce62f9481d87e7fcbf630e1590. Latest consensus state: current_term: 1 leader_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb9c4ce62f9481d87e7fcbf630e1590" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33685 } } }
I20260812 09:50:26.353746 13792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:26.356976 13800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:26.363788 13800 catalog_manager.cc:1347] Generated new cluster ID: 488208d8cebb425b924eab337f5959cd
I20260812 09:50:26.363883 13800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:26.374588 13800 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:26.375970 13800 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:26.385088 13800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Generated new TSK 0
I20260812 09:50:26.386090 13800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:26.427389 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:33685
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:26.546197 13814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:26.546527 13814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:26.546581 13814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:26.550829 13814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:26.550923 13814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:26.550998 13814 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 09:50:26.551014 13814 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:26.551047 13814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:26.557032 13814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:33685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:26.558230 13814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:26.559346 13814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:26.571417 13819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.571714 13822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.571739 13820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:26.572118 13814 server_base.cc:1034] running on GCE node
I20260812 09:50:26.572633 13814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:26.573333 13814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:26.574553 13814 hybrid_clock.cc:648] HybridClock initialized: now 1786528226574535 us; error 27 us; skew 500 ppm
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:26.583503 13814 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:26.584801 13814 webserver.cc:460] Webserver started at http://127.11.118.129:36263/ using document root <none> and password file <none>
I20260812 09:50:26.585430 13814 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:26.585531 13814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:26.585788 13814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:26.588114 13814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "21458132248d4591bd24e1af2a5919c9"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "78b2f5d95f341a0aec7e723a489fbd1f"
server_key_iv: "6e2c1eee6aad063bdfe2c2337a4464ea"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.588755 13814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "21458132248d4591bd24e1af2a5919c9"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "78b2f5d95f341a0aec7e723a489fbd1f"
server_key_iv: "6e2c1eee6aad063bdfe2c2337a4464ea"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.593158 13814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:26.595975 13829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:26.597303 13814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:26.597465 13814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "21458132248d4591bd24e1af2a5919c9"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "78b2f5d95f341a0aec7e723a489fbd1f"
server_key_iv: "6e2c1eee6aad063bdfe2c2337a4464ea"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.597602 13814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:26.615483 13814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:26.618768 13814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:26.619064 13814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:26.620666 13814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:26.620749 13814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:26.620821 13814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:26.620874 13814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:26.633332 13814 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:46607
I20260812 09:50:26.633401 13955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:46607 every 8 connection(s)
I20260812 09:50:26.634501 13814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:26.635777 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13814
I20260812 09:50:26.635921 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:26.636245 11738 external_mini_cluster.cc:1428] Setting key 5298dff3751e3020c654581062b59735
I20260812 09:50:26.637635 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.621931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:37665 (local address 127.11.118.190:33685)
0812 09:50:26.622075 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:26.622078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:26.623311 (+ 1233us) server_negotiation.cc:407] Connection header received
0812 09:50:26.624511 (+ 1200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:26.624515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:26.624581 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:26.624669 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:26.626056 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.627003 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.628358 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.628705 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.628832 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.633031 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:26.633035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:26.633037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:26.633078 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:26.634753 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.635672 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.635677 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.635678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.635786 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.636265 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.636269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.636271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.636540 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:26.636654 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:26.637320 (+ 666us) server_negotiation.cc:299] Negotiation successful
0812 09:50:26.637441 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:50:26.638491 13838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.622551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.129:37665)
0812 09:50:26.623152 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:26.623198 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:26.624280 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:26.624859 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:26.624867 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:26.625230 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:26.625877 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.625914 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.627249 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.627253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.628210 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.628221 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.628897 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.628902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.629753 (+ 851us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.630531 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:26.630557 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:26.632800 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:26.634898 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.634904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.634919 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.635345 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.635924 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.635928 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.635930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.636140 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.636685 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:26.636692 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:26.637032 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 09:50:26.637243 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 09:50:26.637661 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":165,"threads_started":1}
I20260812 09:50:26.639890 13957 heartbeater.cc:347] Connected to a master server at 127.11.118.190:33685
I20260812 09:50:26.640074 13957 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:26.640610 13957 heartbeater.cc:511] Master 127.11.118.190:33685 requested a full tablet report, sending...
I20260812 09:50:26.642102 13731 ts_manager.cc:194] Registered new tserver with Master: 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607)
I20260812 09:50:26.643514 13731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:37665
I20260812 09:50:26.650092 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.642448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:44363 (local address 127.11.118.190:33685)
0812 09:50:26.642586 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:26.642591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:26.642763 (+ 172us) server_negotiation.cc:407] Connection header received
0812 09:50:26.642882 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:26.642885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:26.642930 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:26.643034 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:26.643625 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.644328 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.645200 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.645435 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.645550 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.646767 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:26.646771 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:26.646774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:26.646798 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:26.648355 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.648798 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.648802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.648804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.648929 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.649217 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.649222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.649224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.649413 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:26.649524 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:26.649788 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 09:50:26.649920 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:50:26.650111 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.642167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.129:44363)
0812 09:50:26.642667 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:26.642683 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:26.642794 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:26.643063 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:26.643065 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:26.643331 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:26.643488 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.643500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.644465 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.644468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.645065 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.645074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.645557 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.645560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.645653 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.646249 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:26.646261 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:26.646621 (+ 360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:26.648473 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.648478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.648480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.648693 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.649029 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.649033 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.649035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.649124 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.649512 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:26.649515 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:26.649621 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 09:50:26.649731 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 09:50:26.649894 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:26.674520 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:33685
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:26.794993 13968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:26.795267 13968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:26.795320 13968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:26.799561 13968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:26.799675 13968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:26.799757 13968 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 09:50:26.799813 13968 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:26.799891 13968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:26.805788 13968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:33685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:26.807013 13968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:26.808123 13968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:50:26.818451 13968 server_base.cc:1034] running on GCE node
W20260812 09:50:26.818392 13977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.818467 13974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:26.818398 13975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:26.819336 13968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:26.820089 13968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:26.821328 13968 hybrid_clock.cc:648] HybridClock initialized: now 1786528226821293 us; error 51 us; skew 500 ppm
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:26.824698 13968 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:26.825796 13968 webserver.cc:460] Webserver started at http://127.11.118.130:36221/ using document root <none> and password file <none>
I20260812 09:50:26.826457 13968 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:26.826565 13968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:26.826836 13968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:26.829248 13968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "5adea064cde44bf3985c7f69dbff0767"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "8449a6c6a53554d455eb673a10fc7612"
server_key_iv: "fca89352b86b6b375ef938e2e41860d0"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.829936 13968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "5adea064cde44bf3985c7f69dbff0767"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "8449a6c6a53554d455eb673a10fc7612"
server_key_iv: "fca89352b86b6b375ef938e2e41860d0"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.834352 13968 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:26.837182 13984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:26.838553 13968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:26.838706 13968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "5adea064cde44bf3985c7f69dbff0767"
format_stamp: "Formatted at 2026-08-12 09:50:26 on dist-test-slave-2w3w"
server_key: "8449a6c6a53554d455eb673a10fc7612"
server_key_iv: "fca89352b86b6b375ef938e2e41860d0"
server_key_version: "encryptionkey@0"
I20260812 09:50:26.838843 13968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:26.859366 13968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:26.863272 13968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:26.863504 13968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:26.865077 13968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:26.865155 13968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:26.865231 13968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:26.865289 13968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:26 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:26.876767 13968 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:33461
I20260812 09:50:26.876845 14111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:33461 every 8 connection(s)
I20260812 09:50:26.877951 13968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:26.880477 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.865882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:57755 (local address 127.11.118.190:33685)
0812 09:50:26.866059 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:26.866066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:26.867419 (+ 1353us) server_negotiation.cc:407] Connection header received
0812 09:50:26.868624 (+ 1205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:26.868628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:26.868694 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:26.868808 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:26.870189 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.870741 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.872056 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.872390 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.872527 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.876516 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:26.876521 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:26.876523 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:26.876563 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:26.878219 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.878878 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.878882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.878884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.879020 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.879367 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.879370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.879371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.879584 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:26.879713 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:26.880219 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 09:50:26.880344 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 09:50:26.881250 13993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.866741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.130:57755)
0812 09:50:26.867238 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:26.867291 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:26.868385 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:26.869006 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:26.869013 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:26.869518 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:26.870025 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.870039 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.870897 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.870901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.871876 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.871887 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.872683 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.872687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.872837 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.874366 (+ 1529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:26.874385 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:26.876285 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:26.878353 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.878359 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.878374 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.878750 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.879126 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.879129 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.879130 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.879269 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.879709 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:26.879714 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:26.879949 (+ 235us) client_negotiation.cc:769] Sending connection context
0812 09:50:26.880103 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 09:50:26.880362 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":171,"threads_started":1}
I20260812 09:50:26.882517 14113 heartbeater.cc:347] Connected to a master server at 127.11.118.190:33685
I20260812 09:50:26.882701 14113 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:26.882920 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 13968
I20260812 09:50:26.883064 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:26.883330 14113 heartbeater.cc:511] Master 127.11.118.190:33685 requested a full tablet report, sending...
I20260812 09:50:26.883392 11738 external_mini_cluster.cc:1428] Setting key ae638cec8f1f7efe7fc14d103ad65c38
I20260812 09:50:26.884406 13732 ts_manager.cc:194] Registered new tserver with Master: 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461)
I20260812 09:50:26.885198 13732 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:57755
I20260812 09:50:26.893353 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.885108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.130:40893)
0812 09:50:26.885384 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:26.885400 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:26.885631 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:26.885958 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:26.885960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:26.886177 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:26.886282 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.886288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.887145 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.887148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.887888 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:26.887901 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.888359 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.888365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:26.888500 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.889092 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:26.889114 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:26.889481 (+ 367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:26.891716 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.891718 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.891720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.891922 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.892258 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:26.892260 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:26.892262 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:26.892342 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:26.892919 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:26.892921 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:26.893004 (+ 83us) client_negotiation.cc:769] Sending connection context
0812 09:50:26.893087 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 09:50:26.893205 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":4,"thread_start_us":110,"threads_started":1}
I20260812 09:50:26.893677 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:26.885193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:40893 (local address 127.11.118.190:33685)
0812 09:50:26.885420 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:26.885427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:26.885464 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:50:26.885795 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:26.885798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:26.885848 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:26.885938 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:26.886405 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.886962 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.888020 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:26.888234 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:26.888319 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:26.889643 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:26.889649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:26.889655 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:26.889688 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:26.891602 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.892031 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.892037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.892040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.892146 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:26.892436 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:26.892441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:26.892445 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:26.892811 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:26.892940 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:26.893188 (+ 248us) server_negotiation.cc:299] Negotiation successful
0812 09:50:26.893318 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:26.919727 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:33685
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:27.044202 14122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:27.044579 14122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:27.044673 14122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:27.049065 14122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:27.049175 14122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:27.049256 14122 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 09:50:27.049292 14122 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:27.049364 14122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:27.056310 14122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:33685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:27.057682 14122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:27.058800 14122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:27.069434 14128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:27.069547 14127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:27.069437 14130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:27.069535 14122 server_base.cc:1034] running on GCE node
I20260812 09:50:27.070092 14122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:27.070835 14122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:27.072039 14122 hybrid_clock.cc:648] HybridClock initialized: now 1786528227072012 us; error 45 us; skew 500 ppm
Aug 12 09:50:27 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:27.075384 14122 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:27.076505 14122 webserver.cc:460] Webserver started at http://127.11.118.131:34331/ using document root <none> and password file <none>
I20260812 09:50:27.077153 14122 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:27.077260 14122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:27.077533 14122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:27.079954 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
format_stamp: "Formatted at 2026-08-12 09:50:27 on dist-test-slave-2w3w"
server_key: "3f48c0c705b0341114e92c2f738b3eb6"
server_key_iv: "148f4746aab7fd975837498a453bb8cf"
server_key_version: "encryptionkey@0"
I20260812 09:50:27.080629 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
format_stamp: "Formatted at 2026-08-12 09:50:27 on dist-test-slave-2w3w"
server_key: "3f48c0c705b0341114e92c2f738b3eb6"
server_key_iv: "148f4746aab7fd975837498a453bb8cf"
server_key_version: "encryptionkey@0"
I20260812 09:50:27.085314 14122 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 09:50:27.088400 14137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:27.089838 14122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:27.090034 14122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
format_stamp: "Formatted at 2026-08-12 09:50:27 on dist-test-slave-2w3w"
server_key: "3f48c0c705b0341114e92c2f738b3eb6"
server_key_iv: "148f4746aab7fd975837498a453bb8cf"
server_key_version: "encryptionkey@0"
I20260812 09:50:27.090184 14122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:27.113864 14122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:27.117478 14122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:27.117723 14122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:27.119570 14122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:27.119648 14122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:27.119755 14122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:27.119798 14122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:27 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528227, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:27.131430 14122 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:45595
I20260812 09:50:27.131582 14267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:45595 every 8 connection(s)
I20260812 09:50:27.132406 14122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:27.134838 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.120392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:52587 (local address 127.11.118.190:33685)
0812 09:50:27.120572 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.120580 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.121979 (+ 1399us) server_negotiation.cc:407] Connection header received
0812 09:50:27.123288 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.123292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.123353 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.123453 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:27.125314 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.126056 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.127464 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.127723 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.127832 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.130633 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:27.130637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:27.130640 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:27.130677 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:27.132555 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.133196 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.133199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.133202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.133304 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.133662 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.133667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.133668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.133883 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:27.134003 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.134507 (+ 504us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.134645 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 09:50:27.135666 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.121294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.131:52587)
0812 09:50:27.121813 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.121867 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.123067 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.123665 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.123677 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.124280 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:27.125068 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.125098 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.126198 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.126202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.127326 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.127337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.127886 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.127890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.128085 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.128747 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:27.128764 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:27.130433 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:27.132681 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.132687 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.132701 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.133063 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.133398 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.133401 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.133403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.133555 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.133999 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:27.134006 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:27.134257 (+ 251us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.134454 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.134808 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":183,"threads_started":1}
I20260812 09:50:27.136854 14268 heartbeater.cc:347] Connected to a master server at 127.11.118.190:33685
I20260812 09:50:27.137033 14268 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:27.137565 14268 heartbeater.cc:511] Master 127.11.118.190:33685 requested a full tablet report, sending...
I20260812 09:50:27.138710 13731 ts_manager.cc:194] Registered new tserver with Master: 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:27.138734 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 14122
I20260812 09:50:27.138875 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:27.139330 11738 external_mini_cluster.cc:1428] Setting key 1562eaed2f9a1e3b3ec3060559a1149c
I20260812 09:50:27.139577 13731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:52587
I20260812 09:50:27.142217 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:27.147845 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.139728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:56101 (local address 127.11.118.190:33685)
0812 09:50:27.139873 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.139877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.140062 (+ 185us) server_negotiation.cc:407] Connection header received
0812 09:50:27.140277 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.140280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.140330 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.140431 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:27.140994 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.141779 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.142938 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.143210 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.143330 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.144585 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:27.144589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:27.144592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:27.144616 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:27.146097 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.146553 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.146558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.146560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.146645 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.146940 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.146944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.146945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.147169 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:27.147286 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.147565 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.147680 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:50:27.147856 14274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.139342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.11.118.131:56101)
0812 09:50:27.139979 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.139994 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.140133 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.140456 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.140459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.140717 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:27.140854 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.140862 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.141935 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.141938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.142810 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.142821 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.143337 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.143340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.143449 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.144077 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:27.144098 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:27.144439 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:27.146217 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.146222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.146225 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.146447 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.146741 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.146746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.146748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.146840 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.147273 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:27.147276 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:27.147382 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.147504 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.147669 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":126,"threads_started":1}
Aug 12 09:50:27 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 09:50:27 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:27.174226 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.165280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34172 (local address 127.11.118.190:33685)
0812 09:50:27.165459 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.165463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.165476 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:50:27.165517 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.165520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.165559 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.165657 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:27.166448 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.167044 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.167908 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.168136 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.168248 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.170873 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:27.170876 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:27.170878 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:27.170907 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:27.172446 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.172892 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.172895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.172897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.173020 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.173310 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.173313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.173315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.173523 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:27.173674 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.173920 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.174044 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 09:50:27.177498 13731 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:27.180986 13731 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:27.196766 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.190148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45595 (local address 127.0.0.1:52368)
0812 09:50:27.190569 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.190627 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.190773 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.191911 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.191916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.191940 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.192120 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.192128 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.193466 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.193471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.194927 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.194939 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.196139 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.196263 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196329 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.196450 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.196597 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":135,"threads_started":1}
I20260812 09:50:27.197014 14287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.190538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.0.0.1:35558)
0812 09:50:27.190806 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.190823 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.190934 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.192289 (+ 1355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.192292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.192310 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.192415 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.192422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.194044 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.194048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.195522 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.195532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.196632 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.196723 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196743 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.196806 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.196889 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":94,"thread_start_us":116,"threads_started":1}
I20260812 09:50:27.197379 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.191047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35558 (local address 127.11.118.130:33461)
0812 09:50:27.191485 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.191499 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.191523 (+ 24us) server_negotiation.cc:407] Connection header received
0812 09:50:27.191602 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.191608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.192125 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.192554 (+ 429us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.192664 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.193921 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.195669 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.196521 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196670 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196804 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.197010 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.197200 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":119,"threads_started":1}
I20260812 09:50:27.197482 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.190367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.11.118.131:45595)
0812 09:50:27.191239 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.191252 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.191277 (+ 25us) server_negotiation.cc:407] Connection header received
0812 09:50:27.191449 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.191456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.191705 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.192278 (+ 573us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.192441 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.193341 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.195099 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.195987 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196146 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196307 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.197219 (+ 912us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.197330 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":753,"thread_start_us":130,"threads_started":1}
I20260812 09:50:27.197541 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.191462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.11.118.129:46607)
0812 09:50:27.191827 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.191834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.191881 (+ 47us) server_negotiation.cc:407] Connection header received
0812 09:50:27.192068 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.192074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.192258 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.192400 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.192793 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.193921 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.195610 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.196245 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196366 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196515 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.197304 (+ 789us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.197404 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":81,"threads_started":1}
I20260812 09:50:27.199059 14288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.190926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46607 (local address 127.0.0.1:35664)
0812 09:50:27.191795 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.191811 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.191910 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.192543 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.192545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.192563 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.192658 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.192664 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.194065 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.194075 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.195482 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.195492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.196399 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.196403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.196504 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.196529 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.196610 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.196690 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":95,"thread_start_us":121,"threads_started":1}
I20260812 09:50:27.200637 14193 tablet_service.cc:1467] Processing CreateTablet for tablet 113bc802283541118dd01d83dd78c664 (DEFAULT_TABLE table=test-table [id=561517aa5d3d42908810dc5af41f0340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.200793 14039 tablet_service.cc:1467] Processing CreateTablet for tablet 113bc802283541118dd01d83dd78c664 (DEFAULT_TABLE table=test-table [id=561517aa5d3d42908810dc5af41f0340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.201835 14039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113bc802283541118dd01d83dd78c664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.201869 14193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113bc802283541118dd01d83dd78c664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.201633 13884 tablet_service.cc:1467] Processing CreateTablet for tablet 113bc802283541118dd01d83dd78c664 (DEFAULT_TABLE table=test-table [id=561517aa5d3d42908810dc5af41f0340]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.202589 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 113bc802283541118dd01d83dd78c664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.209699 14292 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Bootstrap starting.
I20260812 09:50:27.210147 14291 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Bootstrap starting.
I20260812 09:50:27.210597 14293 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Bootstrap starting.
I20260812 09:50:27.212517 14292 tablet_bootstrap.cc:654] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.212815 14291 tablet_bootstrap.cc:654] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.212815 14293 tablet_bootstrap.cc:654] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.213595 14292 log.cc:824] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:27.213946 14291 log.cc:824] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:27.214197 14293 log.cc:824] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:27.215926 14292 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: No bootstrap required, opened a new log
I20260812 09:50:27.216085 14293 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: No bootstrap required, opened a new log
I20260812 09:50:27.216085 14291 tablet_bootstrap.cc:492] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: No bootstrap required, opened a new log
I20260812 09:50:27.216198 14292 ts_tablet_manager.cc:1397] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 09:50:27.216279 14291 ts_tablet_manager.cc:1397] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:50:27.216279 14293 ts_tablet_manager.cc:1397] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:50:27.219832 14292 raft_consensus.cc:348] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.220116 14292 raft_consensus.cc:374] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.220172 14292 raft_consensus.cc:729] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.220239 14291 raft_consensus.cc:348] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.220239 14293 raft_consensus.cc:348] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.220494 14291 raft_consensus.cc:374] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.220494 14293 raft_consensus.cc:374] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.220553 14291 raft_consensus.cc:729] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.220563 14293 raft_consensus.cc:729] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.220682 14292 consensus_queue.cc:260] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.220973 14291 consensus_queue.cc:260] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.220973 14293 consensus_queue.cc:260] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.221473 13957 heartbeater.cc:503] Master 127.11.118.190:33685 was elected leader, sending a full tablet report...
I20260812 09:50:27.221753 14292 ts_tablet_manager.cc:1428] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 09:50:27.221913 14293 ts_tablet_manager.cc:1428] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:27.222270 14268 heartbeater.cc:503] Master 127.11.118.190:33685 was elected leader, sending a full tablet report...
I20260812 09:50:27.222908 14291 ts_tablet_manager.cc:1428] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 09:50:27.223084 14113 heartbeater.cc:503] Master 127.11.118.190:33685 was elected leader, sending a full tablet report...
W20260812 09:50:27.379400 14114 tablet.cc:2369] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:27.379779 14299 raft_consensus.cc:482] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:27.380014 14299 raft_consensus.cc:504] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.381213 14299 leader_election.cc:288] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461)
W20260812 09:50:27.383555 14269 tablet.cc:2369] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:27.385378 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.381654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:53343 (local address 127.11.118.130:33461)
0812 09:50:27.381925 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.381931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.381948 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:27.382021 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.382023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.382060 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.382151 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.382459 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.383065 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.384381 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.384772 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.384909 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.384968 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.385180 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.385258 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260812 09:50:27.385378 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.381572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.11.118.131:53343)
0812 09:50:27.381717 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.381778 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.381887 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.382164 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.382167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.382183 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.382340 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.382346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.383175 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.383180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.384246 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.384255 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.384909 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.384913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.385051 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.385069 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.385163 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.385239 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"spinlock_wait_cycles":23680}
I20260812 09:50:27.386046 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.381577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46607 (local address 127.11.118.131:33291)
0812 09:50:27.382078 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.382090 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.382240 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.382508 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.382510 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.382526 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.383158 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.383167 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.383987 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.383993 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.384757 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.384765 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.385588 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.385592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.385708 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.385732 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.385829 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.385899 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":123,"spinlock_wait_cycles":768,"thread_start_us":179,"threads_started":1}
W20260812 09:50:27.386030 13959 tablet.cc:2369] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:27.386075 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.381673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:33291 (local address 127.11.118.129:46607)
0812 09:50:27.381809 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.381817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.382185 (+ 368us) server_negotiation.cc:407] Connection header received
0812 09:50:27.382361 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.382364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.382414 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.382499 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.383278 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.383891 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.384891 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.385336 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.385477 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.385547 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.385872 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.385955 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 09:50:27.386181 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113bc802283541118dd01d83dd78c664" candidate_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767" is_pre_election: true
I20260812 09:50:27.386504 14061 raft_consensus.cc:2454] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6998f7b3e0a84d15a96f4cf44bb3b7de in term 0.
I20260812 09:50:27.386762 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113bc802283541118dd01d83dd78c664" candidate_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9" is_pre_election: true
I20260812 09:50:27.387090 13905 raft_consensus.cc:2454] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6998f7b3e0a84d15a96f4cf44bb3b7de in term 0.
I20260812 09:50:27.387068 14140 leader_election.cc:302] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adea064cde44bf3985c7f69dbff0767, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:27.387364 14299 raft_consensus.cc:2781] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:27.387478 14299 raft_consensus.cc:482] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:27.387533 14299 raft_consensus.cc:3037] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.388826 14299 raft_consensus.cc:504] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.389140 14299 leader_election.cc:288] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [CANDIDATE]: Term 1 election: Requested vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461)
I20260812 09:50:27.389554 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113bc802283541118dd01d83dd78c664" candidate_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9"
I20260812 09:50:27.389714 13905 raft_consensus.cc:3037] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.389678 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "113bc802283541118dd01d83dd78c664" candidate_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767"
I20260812 09:50:27.389869 14061 raft_consensus.cc:3037] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.390900 13905 raft_consensus.cc:2454] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6998f7b3e0a84d15a96f4cf44bb3b7de in term 1.
I20260812 09:50:27.390980 14061 raft_consensus.cc:2454] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6998f7b3e0a84d15a96f4cf44bb3b7de in term 1.
I20260812 09:50:27.391290 14138 leader_election.cc:302] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:27.391489 14299 raft_consensus.cc:2781] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:27.391808 14299 raft_consensus.cc:686] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 LEADER]: Becoming Leader. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Running, Role: LEADER
I20260812 09:50:27.392184 14299 consensus_queue.cc:237] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } }
I20260812 09:50:27.395601 13730 catalog_manager.cc:5495] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de reported cstate change: term changed from 0 to 1, leader changed from <none> to 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131). New cstate: current_term: 1 leader_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } health_report { overall_health: UNKNOWN } } }
Aug 12 09:50:27 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:27.466069 14309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.456856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33685 (local address 127.0.0.1:34182)
0812 09:50:27.457183 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.457197 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.457336 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.457605 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.457608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.458056 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:27.458152 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.458158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.458931 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.458936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.459529 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.459537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.460003 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.460006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.460086 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.460705 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:27.460718 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:27.462241 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:27.464220 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.464234 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.464241 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.464500 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.464788 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:27.464793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:27.464795 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:27.464881 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:27.465301 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:27.465310 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:27.465436 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.465568 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.465833 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":18,"thread_start_us":117,"threads_started":1}
I20260812 09:50:27.466068 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.456937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.11.118.190:33685)
0812 09:50:27.457093 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.457098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.457280 (+ 182us) server_negotiation.cc:407] Connection header received
0812 09:50:27.457449 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.457459 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.457498 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.457588 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:27.458282 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.458816 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.459661 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.459881 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.459999 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.462397 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:27.462400 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:27.462402 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:27.462423 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:27.464104 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.464607 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.464612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.464614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.464696 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:27.464979 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:27.464982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:27.464984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:27.465186 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:27.465301 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.465617 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.465892 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":67}
I20260812 09:50:27.470309 13730 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:34182:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 09:50:27.471153 13730 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:27.476372 14039 tablet_service.cc:1467] Processing CreateTablet for tablet f6efd8cf751141f480131ef5c14b4787 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d6008bde14d4738bdc84381ae481dab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:27.476336 13884 tablet_service.cc:1467] Processing CreateTablet for tablet f6efd8cf751141f480131ef5c14b4787 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d6008bde14d4738bdc84381ae481dab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:27.476527 14193 tablet_service.cc:1467] Processing CreateTablet for tablet f6efd8cf751141f480131ef5c14b4787 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d6008bde14d4738bdc84381ae481dab]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:27.477092 14039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6efd8cf751141f480131ef5c14b4787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.477087 14193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6efd8cf751141f480131ef5c14b4787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.477087 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6efd8cf751141f480131ef5c14b4787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.479785 14291 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: Bootstrap starting.
I20260812 09:50:27.480093 14293 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Bootstrap starting.
I20260812 09:50:27.480306 14292 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: Bootstrap starting.
I20260812 09:50:27.480906 14291 tablet_bootstrap.cc:654] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.481122 14292 tablet_bootstrap.cc:654] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.481154 14293 tablet_bootstrap.cc:654] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.482527 14292 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: No bootstrap required, opened a new log
I20260812 09:50:27.482637 14292 ts_tablet_manager.cc:1397] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:27.482801 14291 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: No bootstrap required, opened a new log
I20260812 09:50:27.482801 14293 tablet_bootstrap.cc:492] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: No bootstrap required, opened a new log
I20260812 09:50:27.482892 14293 ts_tablet_manager.cc:1397] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:27.482892 14291 ts_tablet_manager.cc:1397] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:27.483229 14292 raft_consensus.cc:348] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483373 14292 raft_consensus.cc:374] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.483414 14292 raft_consensus.cc:729] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.483366 14293 raft_consensus.cc:348] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483385 14291 raft_consensus.cc:348] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483489 14293 raft_consensus.cc:374] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.483487 14291 raft_consensus.cc:374] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.483526 14293 raft_consensus.cc:729] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.483526 14291 raft_consensus.cc:729] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.483539 14292 consensus_queue.cc:260] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483654 14293 consensus_queue.cc:260] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483654 14291 consensus_queue.cc:260] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.483821 14292 ts_tablet_manager.cc:1428] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:27.483908 14291 ts_tablet_manager.cc:1428] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:27.483892 14299 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.484023 14299 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.484094 14297 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.484123 14298 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.484216 14297 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.484243 14298 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.484699 14293 ts_tablet_manager.cc:1428] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:27.628422 14298 raft_consensus.cc:482] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:27.628578 14298 raft_consensus.cc:504] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.629777 14298 leader_election.cc:288] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:27.635084 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.630732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:53347 (local address 127.11.118.131:45595)
0812 09:50:27.630852 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.630876 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.630895 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:50:27.630953 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.630956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.631033 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.631114 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.631800 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.632499 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.633819 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.634409 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.634552 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.634607 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.634845 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.634931 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 09:50:27.635099 14314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.630389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45595 (local address 127.11.118.130:53347)
0812 09:50:27.630663 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.630679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.630776 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.631201 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.631204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.631228 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.631680 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.631687 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.632595 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.632598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.633677 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.633689 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.634579 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.634582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.634692 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.634719 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.634824 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.634900 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":95,"threads_started":1}
I20260812 09:50:27.635843 14216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6efd8cf751141f480131ef5c14b4787" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" is_pre_election: true
I20260812 09:50:27.636134 14216 raft_consensus.cc:2454] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 0.
I20260812 09:50:27.636649 13985 leader_election.cc:302] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adea064cde44bf3985c7f69dbff0767, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:27.637117 14298 raft_consensus.cc:2781] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:27.637203 14298 raft_consensus.cc:482] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:27.637279 14298 raft_consensus.cc:3037] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.638614 14298 raft_consensus.cc:504] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.639051 14298 leader_election.cc:288] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 election: Requested vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:27.639381 14216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6efd8cf751141f480131ef5c14b4787" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
I20260812 09:50:27.639513 14216 raft_consensus.cc:3037] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.640646 14216 raft_consensus.cc:2454] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 1.
I20260812 09:50:27.640971 13985 leader_election.cc:302] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5adea064cde44bf3985c7f69dbff0767, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:27.641173 14298 raft_consensus.cc:2781] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:27.641217 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.630821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:40595 (local address 127.11.118.129:46607)
0812 09:50:27.630993 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.630998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.631010 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:50:27.631062 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.631068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.631122 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.631197 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.631487 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.632242 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.639812 (+ 7570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.640533 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.640658 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.640706 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.640963 (+ 257us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.641088 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:50:27.641392 14298 raft_consensus.cc:686] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [term 1 LEADER]: Becoming Leader. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Running, Role: LEADER
I20260812 09:50:27.641594 14313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.629985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46607 (local address 127.11.118.130:40595)
0812 09:50:27.630334 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.630351 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.630456 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.631211 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.631213 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.631238 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.631360 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.631369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.632368 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.632370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.639665 (+ 7295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.639680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.640671 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.640675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.640793 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.640831 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.641359 (+ 528us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.641453 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"spinlock_wait_cycles":9856,"thread_start_us":101,"threads_started":1}
I20260812 09:50:27.641755 14298 consensus_queue.cc:237] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.642057 13905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6efd8cf751141f480131ef5c14b4787" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9" is_pre_election: true
I20260812 09:50:27.642113 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6efd8cf751141f480131ef5c14b4787" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9"
I20260812 09:50:27.642177 13905 raft_consensus.cc:2454] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 0.
I20260812 09:50:27.644165 14298 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: TxnStatusTablet state changed. Reason: New leader 5adea064cde44bf3985c7f69dbff0767. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.644361 14298 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:27.644727 14317 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 09:50:27.644973 14317 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 09:50:27.644979 13730 catalog_manager.cc:5495] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:27.677904 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.674193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35564 (local address 127.11.118.130:33461)
0812 09:50:27.674329 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.674334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.674349 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:27.674492 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.674495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.674559 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.674668 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:27.675002 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.675513 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.676401 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.676626 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.676740 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.677069 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.677500 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.677629 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.677706 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.677757 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 09:50:27.677907 14309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.674027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.0.0.1:35564)
0812 09:50:27.674213 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.674233 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.674350 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.674689 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.674693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.674700 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:27.674857 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.674863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.675641 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.675645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.676267 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.676276 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.676741 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.676745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.676852 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.676899 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.677605 (+ 706us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.677624 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.677697 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.677783 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 09:50:27.683202 13904 raft_consensus.cc:3037] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.683358 14216 raft_consensus.cc:1261] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Refusing update from remote peer 5adea064cde44bf3985c7f69dbff0767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:27.683945 14298 consensus_queue.cc:1035] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:27.684886 13904 raft_consensus.cc:1261] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Refusing update from remote peer 5adea064cde44bf3985c7f69dbff0767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:27.687711 14299 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: TxnStatusTablet state changed. Reason: New leader 5adea064cde44bf3985c7f69dbff0767. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.687852 14299 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.688354 14298 consensus_queue.cc:1035] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:27.690834 14298 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.690955 14298 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:27.691215 14320 mvcc.cc:205] Tried to move back new op lower bound from 7317619620583510016 to 7317619620423409664. Current Snapshot: MvccSnapshot[applied={T|T < 7317619620583510016}]
I20260812 09:50:27.692412 14299 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.692539 14299 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 6998f7b3e0a84d15a96f4cf44bb3b7de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.693724 14297 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: TxnStatusTablet state changed. Reason: New leader 5adea064cde44bf3985c7f69dbff0767. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.693872 14297 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.694655 14321 mvcc.cc:205] Tried to move back new op lower bound from 7317619620583510016 to 7317619620423409664. Current Snapshot: MvccSnapshot[applied={T|T < 7317619620583510016}]
I20260812 09:50:27.695915 14298 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.696051 14298 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 5adea064cde44bf3985c7f69dbff0767: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:27.697805 14297 tablet_replica.cc:439] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } } }
I20260812 09:50:27.697943 14297 tablet_replica.cc:442] T f6efd8cf751141f480131ef5c14b4787 P 21458132248d4591bd24e1af2a5919c9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:27.698477 14324 mvcc.cc:205] Tried to move back new op lower bound from 7317619620583510016 to 7317619620423409664. Current Snapshot: MvccSnapshot[applied={T|T < 7317619620583510016}]
I20260812 09:50:27.707911 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.703849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.11.118.131:45595)
0812 09:50:27.704001 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.704006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.704204 (+ 198us) server_negotiation.cc:407] Connection header received
0812 09:50:27.704351 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.704353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.704406 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.704500 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:27.704763 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.705268 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.706496 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.706720 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.706796 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.707109 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.707540 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.707629 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.707720 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.707768 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:27.720440 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.716006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:47469 (local address 127.11.118.130:33461)
0812 09:50:27.716232 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.716236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.716328 (+ 92us) server_negotiation.cc:407] Connection header received
0812 09:50:27.716460 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.716463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.716509 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.716573 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:27.716860 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.718076 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.719353 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.719567 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.719650 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.720020 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.720095 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.720150 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.720280 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.720325 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260812 09:50:27.720522 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.715832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.11.118.131:47469)
0812 09:50:27.716236 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.716252 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.716365 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.716606 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.716609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.716617 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:27.716758 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.716764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.718196 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.718200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.719230 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.719241 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.719686 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.719690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.719797 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.719853 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.720184 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.720191 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.720261 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.720344 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":177,"threads_started":1}
I20260812 09:50:27.728365 13904 raft_consensus.cc:1261] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Refusing update from remote peer 6998f7b3e0a84d15a96f4cf44bb3b7de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:27.728554 14061 raft_consensus.cc:1261] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Refusing update from remote peer 6998f7b3e0a84d15a96f4cf44bb3b7de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:27.729146 14301 consensus_queue.cc:1035] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [LEADER]: Connected to new peer: Peer: permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:27.729555 14301 consensus_queue.cc:1035] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:27.756699 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.752312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58523 (local address 127.11.118.131:45595)
0812 09:50:27.752468 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.752473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.752491 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:27.752636 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.752639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.752691 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.752780 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:27.753170 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.753870 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.755164 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.755433 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.755561 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.756001 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.756102 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.756183 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.756511 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.756579 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 09:50:27.756712 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.751895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45595 (local address 127.11.118.130:58523)
0812 09:50:27.752424 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.752441 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.752537 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.752897 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.752900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.752908 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:27.753014 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.753020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.753995 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.753998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.755029 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.755042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.755680 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.755684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.755782 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.755844 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:27.756213 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:27.756346 (+ 133us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.756466 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.756557 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":131,"threads_started":1}
I20260812 09:50:27.785969 13729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:27.786197 13729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:27.789258 13729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Sending DeleteTablet for 3 replicas of tablet 113bc802283541118dd01d83dd78c664
I20260812 09:50:27.790195 14193 tablet_service.cc:1514] Processing DeleteTablet for tablet 113bc802283541118dd01d83dd78c664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:27 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:52368
I20260812 09:50:27.790344 13884 tablet_service.cc:1514] Processing DeleteTablet for tablet 113bc802283541118dd01d83dd78c664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:27 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35664
I20260812 09:50:27.790484 14039 tablet_service.cc:1514] Processing DeleteTablet for tablet 113bc802283541118dd01d83dd78c664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:27 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35558
I20260812 09:50:27.791103 14346 tablet_replica.cc:330] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: stopping tablet replica
I20260812 09:50:27.791529 14346 raft_consensus.cc:2229] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:27.791869 14346 raft_consensus.cc:2258] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:27.791836 13729 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:27.792308 13729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:27.793731 14346 ts_tablet_manager.cc:1905] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:27.794595 14347 tablet_replica.cc:330] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: stopping tablet replica
I20260812 09:50:27.794977 14347 raft_consensus.cc:2229] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:27.795163 14347 raft_consensus.cc:2258] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:27.796594 14347 ts_tablet_manager.cc:1905] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:27.797933 14345 tablet_replica.cc:330] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: stopping tablet replica
I20260812 09:50:27.798272 14345 raft_consensus.cc:2229] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:27.798640 14345 raft_consensus.cc:2258] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:27.799438 13884 tablet_service.cc:1467] Processing CreateTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (DEFAULT_TABLE table=test-table [id=73d5126c2d9e4723bfe44501cc003e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.799783 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f9ce643d7814a47a8efcbc1d7426ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.802321 14347 ts_tablet_manager.cc:1918] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:27.802430 14347 log.cc:1196] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/113bc802283541118dd01d83dd78c664
I20260812 09:50:27.802759 14347 ts_tablet_manager.cc:1939] T 113bc802283541118dd01d83dd78c664 P 5adea064cde44bf3985c7f69dbff0767: Deleting consensus metadata
I20260812 09:50:27.802868 14193 tablet_service.cc:1467] Processing CreateTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (DEFAULT_TABLE table=test-table [id=73d5126c2d9e4723bfe44501cc003e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.803182 14193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f9ce643d7814a47a8efcbc1d7426ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.805272 14345 ts_tablet_manager.cc:1905] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:27.805523 14293 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Bootstrap starting.
I20260812 09:50:27.805756 14292 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Bootstrap starting.
I20260812 09:50:27.806558 14293 tablet_bootstrap.cc:654] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.806725 14292 tablet_bootstrap.cc:654] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.808218 14345 ts_tablet_manager.cc:1918] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:27.808326 14345 log.cc:1196] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/113bc802283541118dd01d83dd78c664
I20260812 09:50:27.808568 13717 catalog_manager.cc:4841] TS 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461): tablet 113bc802283541118dd01d83dd78c664 (table test-table [id=561517aa5d3d42908810dc5af41f0340]) successfully deleted
I20260812 09:50:27.808921 14039 tablet_service.cc:1467] Processing CreateTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (DEFAULT_TABLE table=test-table [id=73d5126c2d9e4723bfe44501cc003e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:27.809209 14039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f9ce643d7814a47a8efcbc1d7426ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:27.811856 14291 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Bootstrap starting.
I20260812 09:50:27.812681 14346 ts_tablet_manager.cc:1918] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:27.812880 14291 tablet_bootstrap.cc:654] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:27.813225 14292 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: No bootstrap required, opened a new log
I20260812 09:50:27.813407 14292 ts_tablet_manager.cc:1397] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260812 09:50:27.813889 14292 raft_consensus.cc:348] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.813998 14292 raft_consensus.cc:374] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.814029 14292 raft_consensus.cc:729] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.814150 14292 consensus_queue.cc:260] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.814424 14292 ts_tablet_manager.cc:1428] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:27.815282 14345 ts_tablet_manager.cc:1939] T 113bc802283541118dd01d83dd78c664 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting consensus metadata
I20260812 09:50:27.816603 13715 catalog_manager.cc:4841] TS 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595): tablet 113bc802283541118dd01d83dd78c664 (table test-table [id=561517aa5d3d42908810dc5af41f0340]) successfully deleted
I20260812 09:50:27.816848 14346 log.cc:1196] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/113bc802283541118dd01d83dd78c664
I20260812 09:50:27.817255 14346 ts_tablet_manager.cc:1939] T 113bc802283541118dd01d83dd78c664 P 21458132248d4591bd24e1af2a5919c9: Deleting consensus metadata
I20260812 09:50:27.818353 14291 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: No bootstrap required, opened a new log
I20260812 09:50:27.818447 14291 ts_tablet_manager.cc:1397] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 09:50:27.818415 13715 catalog_manager.cc:4841] TS 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607): tablet 113bc802283541118dd01d83dd78c664 (table test-table [id=561517aa5d3d42908810dc5af41f0340]) successfully deleted
I20260812 09:50:27.818868 14291 raft_consensus.cc:348] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.819057 14291 raft_consensus.cc:374] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.819103 14291 raft_consensus.cc:729] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.819231 14291 consensus_queue.cc:260] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.819514 14291 ts_tablet_manager.cc:1428] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:27.820276 14293 tablet_bootstrap.cc:492] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: No bootstrap required, opened a new log
I20260812 09:50:27.820372 14293 ts_tablet_manager.cc:1397] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260812 09:50:27.820838 14293 raft_consensus.cc:348] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.820955 14293 raft_consensus.cc:374] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:27.820997 14293 raft_consensus.cc:729] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Initialized, Role: FOLLOWER
I20260812 09:50:27.821125 14293 consensus_queue.cc:260] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.821395 14293 ts_tablet_manager.cc:1428] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 09:50:27.960157 14297 raft_consensus.cc:482] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:27.960325 14297 raft_consensus.cc:504] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.961547 14297 leader_election.cc:288] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:27.965956 14286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.961923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:59605 (local address 127.11.118.131:45595)
0812 09:50:27.962065 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.962069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.962375 (+ 306us) server_negotiation.cc:407] Connection header received
0812 09:50:27.962587 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.962597 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.962646 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.962736 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.963066 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.963590 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.964838 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.965277 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.965426 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.965489 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.965725 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.965816 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:27.965979 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.961922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47249 (local address 127.11.118.130:33461)
0812 09:50:27.962078 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:27.962086 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:27.962514 (+ 428us) server_negotiation.cc:407] Connection header received
0812 09:50:27.962659 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:27.962662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:27.962715 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:27.962807 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:27.963138 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.963824 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.964903 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.965296 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.965438 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.965497 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:27.965772 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 09:50:27.965854 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:27.966002 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.961819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45595 (local address 127.11.118.129:59605)
0812 09:50:27.962261 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.962274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.962425 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.962751 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.962754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.962770 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.962912 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.962918 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.963754 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.963757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.964688 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.964698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.965428 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.965432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.965570 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.965611 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.965675 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.965779 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":5,"thread_start_us":150,"threads_started":1}
I20260812 09:50:27.966007 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:27.961836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.11.118.129:47249)
0812 09:50:27.962378 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:27.962396 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:27.962554 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:27.962818 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:27.962821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:27.962839 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:27.963012 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.963021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.963972 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.963974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.964732 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:27.964741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:27.965450 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:27.965453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:27.965613 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:27.965631 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:50:27.965734 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 09:50:27.965805 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":42,"thread_start_us":126,"threads_started":1}
I20260812 09:50:27.966703 14216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f9ce643d7814a47a8efcbc1d7426ec1" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" is_pre_election: true
I20260812 09:50:27.966732 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f9ce643d7814a47a8efcbc1d7426ec1" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767" is_pre_election: true
I20260812 09:50:27.966897 14216 raft_consensus.cc:2454] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 0.
I20260812 09:50:27.966893 14061 raft_consensus.cc:2454] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 0.
I20260812 09:50:27.968079 13832 leader_election.cc:302] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 5adea064cde44bf3985c7f69dbff0767; no voters:
I20260812 09:50:27.968420 14297 raft_consensus.cc:2781] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:27.968500 14297 raft_consensus.cc:482] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:27.968532 14297 raft_consensus.cc:3037] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.969633 14297 raft_consensus.cc:504] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.970026 14297 leader_election.cc:288] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 election: Requested vote from peers 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:27.970520 14216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f9ce643d7814a47a8efcbc1d7426ec1" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
I20260812 09:50:27.970520 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f9ce643d7814a47a8efcbc1d7426ec1" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767"
I20260812 09:50:27.970661 14216 raft_consensus.cc:3037] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.970661 14061 raft_consensus.cc:3037] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:27.971961 14216 raft_consensus.cc:2454] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 1.
I20260812 09:50:27.971956 14061 raft_consensus.cc:2454] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 1.
I20260812 09:50:27.972261 13832 leader_election.cc:302] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 5adea064cde44bf3985c7f69dbff0767; no voters:
I20260812 09:50:27.972467 14297 raft_consensus.cc:2781] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:27.972690 14297 raft_consensus.cc:686] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 1 LEADER]: Becoming Leader. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Running, Role: LEADER
I20260812 09:50:27.972966 14297 consensus_queue.cc:237] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:27.975461 13730 catalog_manager.cc:5495] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21458132248d4591bd24e1af2a5919c9 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "21458132248d4591bd24e1af2a5919c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:28.017730 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:28.014109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35676 (local address 127.11.118.129:46607)
0812 09:50:28.014213 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:28.014216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:28.014256 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:50:28.014423 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:28.014425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:28.014480 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:28.014571 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:28.014798 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.015385 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.016192 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.016398 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.016476 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:28.016733 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:28.017309 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:28.017436 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:28.017495 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 09:50:28.017605 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 09:50:28.028331 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:28.024795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:36065 (local address 127.11.118.130:33461)
0812 09:50:28.024959 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:28.024964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:28.025122 (+ 158us) server_negotiation.cc:407] Connection header received
0812 09:50:28.025287 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:28.025291 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:28.025349 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:28.025431 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:28.025709 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.026231 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.027181 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.027408 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.027530 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:28.027854 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:28.027930 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:28.028015 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:28.028109 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 09:50:28.028163 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 09:50:28.028353 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:28.024636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.11.118.129:36065)
0812 09:50:28.025034 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:28.025047 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:28.025182 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:28.025457 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:28.025460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:28.025468 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:28.025601 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:28.025607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.026350 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.026354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:28.027052 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:28.027063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.027535 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.027539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:28.027648 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:28.027695 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:28.028024 (+ 329us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:28.028034 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 09:50:28.028099 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 09:50:28.028186 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":119,"threads_started":1}
I20260812 09:50:28.034643 14061 raft_consensus.cc:1261] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Refusing update from remote peer 21458132248d4591bd24e1af2a5919c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:28.035183 14216 raft_consensus.cc:1261] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Refusing update from remote peer 21458132248d4591bd24e1af2a5919c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:28.035308 14353 consensus_queue.cc:1035] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:28.035583 14297 consensus_queue.cc:1035] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:28.054949 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:28.051216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46607 (local address 127.11.118.130:56189)
0812 09:50:28.051363 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:28.051385 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:28.051454 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:28.051701 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:28.051729 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:28.051738 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:28.051843 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:28.051848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.052725 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.052730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:28.053583 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:28.053595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.054218 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.054222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:28.054316 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:28.054350 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:28.054661 (+ 311us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:28.054668 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:50:28.054743 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 09:50:28.054832 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 09:50:28.054945 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:28.051292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:56189 (local address 127.11.118.129:46607)
0812 09:50:28.051420 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:28.051427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:28.051463 (+ 36us) server_negotiation.cc:407] Connection header received
0812 09:50:28.051532 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:28.051535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:28.051590 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:28.051672 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:28.051983 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.052615 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.053731 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:28.054079 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:28.054216 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:28.054471 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:28.054561 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:28.054645 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:28.054756 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 09:50:28.054805 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 09:50:28.055686 14324 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 09:50:29.615114 13729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:29.615272 13729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:29.617775 13729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Sending DeleteTablet for 3 replicas of tablet 9f9ce643d7814a47a8efcbc1d7426ec1
I20260812 09:50:29.618444 13884 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:29 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35664
I20260812 09:50:29.618471 14039 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:29 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35558
I20260812 09:50:29.618572 14193 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f9ce643d7814a47a8efcbc1d7426ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:29 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:52368
I20260812 09:50:29.618834 14386 tablet_replica.cc:330] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: stopping tablet replica
I20260812 09:50:29.619004 14386 raft_consensus.cc:2229] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:29.619575 14390 tablet_replica.cc:330] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: stopping tablet replica
I20260812 09:50:29.619714 14390 raft_consensus.cc:2229] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:29.619788 14386 raft_consensus.cc:2258] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:29.619866 14390 raft_consensus.cc:2258] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:29.620100 14389 tablet_replica.cc:330] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: stopping tablet replica
I20260812 09:50:29.620246 14389 raft_consensus.cc:2229] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:29.620383 14389 raft_consensus.cc:2258] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:29.620610 14390 ts_tablet_manager.cc:1905] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:29.620906 14386 ts_tablet_manager.cc:1905] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:29.623549 14386 ts_tablet_manager.cc:1918] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 09:50:29.623549 14390 ts_tablet_manager.cc:1918] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 09:50:29.623641 14390 log.cc:1196] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/9f9ce643d7814a47a8efcbc1d7426ec1
I20260812 09:50:29.623641 14386 log.cc:1196] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/9f9ce643d7814a47a8efcbc1d7426ec1
I20260812 09:50:29.623698 14389 ts_tablet_manager.cc:1905] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:29.623963 14390 ts_tablet_manager.cc:1939] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting consensus metadata
I20260812 09:50:29.623963 14386 ts_tablet_manager.cc:1939] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 21458132248d4591bd24e1af2a5919c9: Deleting consensus metadata
I20260812 09:50:29.625164 13715 catalog_manager.cc:4841] TS 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607): tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (table test-table [id=73d5126c2d9e4723bfe44501cc003e97]) successfully deleted
I20260812 09:50:29.625387 13715 catalog_manager.cc:4841] TS 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595): tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (table test-table [id=73d5126c2d9e4723bfe44501cc003e97]) successfully deleted
I20260812 09:50:29.626319 14389 ts_tablet_manager.cc:1918] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 09:50:29.626405 14389 log.cc:1196] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/9f9ce643d7814a47a8efcbc1d7426ec1
I20260812 09:50:29.626649 14389 ts_tablet_manager.cc:1939] T 9f9ce643d7814a47a8efcbc1d7426ec1 P 5adea064cde44bf3985c7f69dbff0767: Deleting consensus metadata
I20260812 09:50:29.627581 13717 catalog_manager.cc:4841] TS 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461): tablet 9f9ce643d7814a47a8efcbc1d7426ec1 (table test-table [id=73d5126c2d9e4723bfe44501cc003e97]) successfully deleted
Aug 12 09:50:29 dist-test-slave-2w3w krb5kdc[13682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528229, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 09:50:29 dist-test-slave-2w3w krb5kdc[13682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528229, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:29.653654 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:29.643750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53890 (local address 127.11.118.190:33685)
0812 09:50:29.644138 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:29.644148 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:29.644394 (+ 246us) server_negotiation.cc:407] Connection header received
0812 09:50:29.644492 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:29.644495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:29.644548 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:29.644655 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:29.645460 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:29.646318 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:29.647305 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:29.647668 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:29.647768 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:29.650459 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:29.650463 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:29.650465 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:29.650491 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:29.651981 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:29.652421 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:29.652423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:29.652425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:29.652505 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:29.652800 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:29.652802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:29.652803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:29.653069 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:29.653177 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:29.653400 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 09:50:29.653515 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":112,"threads_started":1}
I20260812 09:50:29.656617 13729 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:29.657090 13729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:29.662096 13884 tablet_service.cc:1467] Processing CreateTablet for tablet 80d635ea97464595b8567443de29ff75 (DEFAULT_TABLE table=test-table [id=3a40c6db4432450eb82ff57a32933f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:29.662147 14039 tablet_service.cc:1467] Processing CreateTablet for tablet 80d635ea97464595b8567443de29ff75 (DEFAULT_TABLE table=test-table [id=3a40c6db4432450eb82ff57a32933f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:29.662339 14193 tablet_service.cc:1467] Processing CreateTablet for tablet 80d635ea97464595b8567443de29ff75 (DEFAULT_TABLE table=test-table [id=3a40c6db4432450eb82ff57a32933f5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:29.662470 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d635ea97464595b8567443de29ff75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:29.662470 14039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d635ea97464595b8567443de29ff75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:29.662664 14193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d635ea97464595b8567443de29ff75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:29.665366 14401 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Bootstrap starting.
I20260812 09:50:29.665386 14402 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Bootstrap starting.
I20260812 09:50:29.665386 14400 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Bootstrap starting.
I20260812 09:50:29.666257 14401 tablet_bootstrap.cc:654] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:29.666294 14400 tablet_bootstrap.cc:654] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:29.666287 14402 tablet_bootstrap.cc:654] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:29.667558 14402 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: No bootstrap required, opened a new log
I20260812 09:50:29.667567 14400 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: No bootstrap required, opened a new log
I20260812 09:50:29.667672 14400 ts_tablet_manager.cc:1397] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:29.667672 14402 ts_tablet_manager.cc:1397] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:29.668135 14400 raft_consensus.cc:348] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.668251 14400 raft_consensus.cc:374] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:29.668166 14402 raft_consensus.cc:348] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.668283 14400 raft_consensus.cc:729] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Initialized, Role: FOLLOWER
I20260812 09:50:29.668293 14402 raft_consensus.cc:374] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:29.668344 14402 raft_consensus.cc:729] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Initialized, Role: FOLLOWER
I20260812 09:50:29.668423 14400 consensus_queue.cc:260] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.668473 14402 consensus_queue.cc:260] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.668759 14402 ts_tablet_manager.cc:1428] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 09:50:29.668812 14400 ts_tablet_manager.cc:1428] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:29.669462 14401 tablet_bootstrap.cc:492] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: No bootstrap required, opened a new log
I20260812 09:50:29.669564 14401 ts_tablet_manager.cc:1397] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 09:50:29.670024 14401 raft_consensus.cc:348] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.670164 14401 raft_consensus.cc:374] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:29.670197 14401 raft_consensus.cc:729] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Initialized, Role: FOLLOWER
I20260812 09:50:29.670389 14401 consensus_queue.cc:260] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.670674 14401 ts_tablet_manager.cc:1428] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:29.908480 14377 raft_consensus.cc:482] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:29.908640 14377 raft_consensus.cc:504] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.909049 14377 leader_election.cc:288] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:29.909615 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d635ea97464595b8567443de29ff75" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767" is_pre_election: true
I20260812 09:50:29.909619 14215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d635ea97464595b8567443de29ff75" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" is_pre_election: true
I20260812 09:50:29.909796 14061 raft_consensus.cc:2454] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 0.
I20260812 09:50:29.909806 14215 raft_consensus.cc:2454] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 0.
I20260812 09:50:29.910198 13830 leader_election.cc:302] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:29.910432 14377 raft_consensus.cc:2781] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:29.910497 14377 raft_consensus.cc:482] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:29.910524 14377 raft_consensus.cc:3037] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:29.911659 14377 raft_consensus.cc:504] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.912104 14377 leader_election.cc:288] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 election: Requested vote from peers 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:29.912573 14215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d635ea97464595b8567443de29ff75" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
I20260812 09:50:29.912732 14215 raft_consensus.cc:3037] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:29.912738 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d635ea97464595b8567443de29ff75" candidate_uuid: "21458132248d4591bd24e1af2a5919c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5adea064cde44bf3985c7f69dbff0767"
I20260812 09:50:29.912935 14061 raft_consensus.cc:3037] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:29.913875 14215 raft_consensus.cc:2454] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 1.
I20260812 09:50:29.913901 14061 raft_consensus.cc:2454] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21458132248d4591bd24e1af2a5919c9 in term 1.
I20260812 09:50:29.914235 13830 leader_election.cc:302] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 6998f7b3e0a84d15a96f4cf44bb3b7de; no voters:
I20260812 09:50:29.914438 14377 raft_consensus.cc:2781] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:29.914551 14377 raft_consensus.cc:686] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 1 LEADER]: Becoming Leader. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Running, Role: LEADER
I20260812 09:50:29.914701 14377 consensus_queue.cc:237] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:29.916699 13731 catalog_manager.cc:5495] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21458132248d4591bd24e1af2a5919c9 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "21458132248d4591bd24e1af2a5919c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:29.971235 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:29.967643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49260 (local address 127.11.118.129:46607)
0812 09:50:29.967996 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:29.968003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:29.968015 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:50:29.968058 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:29.968060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:29.968101 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:29.968200 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:29.968486 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:29.969037 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:29.970067 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:29.970307 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:29.970425 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:29.970706 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:29.970789 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:29.970875 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:29.970996 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 09:50:29.971057 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":104,"threads_started":1}
I20260812 09:50:29.978238 14215 raft_consensus.cc:1261] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Refusing update from remote peer 21458132248d4591bd24e1af2a5919c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:29.978310 14061 raft_consensus.cc:1261] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Refusing update from remote peer 21458132248d4591bd24e1af2a5919c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:29.978648 14353 consensus_queue.cc:1035] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:29.978807 14377 consensus_queue.cc:1035] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:30.015205 13731 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:30.015493 13731 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:30.017704 13731 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Sending DeleteTablet for 3 replicas of tablet 80d635ea97464595b8567443de29ff75
I20260812 09:50:30.018366 13884 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d635ea97464595b8567443de29ff75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:30 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35664
I20260812 09:50:30.018483 14039 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d635ea97464595b8567443de29ff75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:30 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35558
I20260812 09:50:30.018486 14193 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d635ea97464595b8567443de29ff75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:30 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:52368
I20260812 09:50:30.018608 14386 tablet_replica.cc:330] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: stopping tablet replica
I20260812 09:50:30.018663 14389 tablet_replica.cc:330] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: stopping tablet replica
I20260812 09:50:30.018733 14386 raft_consensus.cc:2229] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:30.018775 14389 raft_consensus.cc:2229] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:30.018903 14389 raft_consensus.cc:2258] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:30.018927 14386 raft_consensus.cc:2258] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:30.019140 14390 tablet_replica.cc:330] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: stopping tablet replica
I20260812 09:50:30.019281 14390 raft_consensus.cc:2229] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:30.019380 14390 raft_consensus.cc:2258] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:30.019977 13731 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 09:50:30.020449 14389 ts_tablet_manager.cc:1905] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 09:50:30.020601 13731 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:30.020612 14390 ts_tablet_manager.cc:1905] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:30.023278 14389 ts_tablet_manager.cc:1918] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:30.023336 14390 ts_tablet_manager.cc:1918] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:30.023386 14389 log.cc:1196] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/80d635ea97464595b8567443de29ff75
I20260812 09:50:30.023486 14390 log.cc:1196] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/80d635ea97464595b8567443de29ff75
I20260812 09:50:30.023669 14389 ts_tablet_manager.cc:1939] T 80d635ea97464595b8567443de29ff75 P 5adea064cde44bf3985c7f69dbff0767: Deleting consensus metadata
I20260812 09:50:30.023770 14390 ts_tablet_manager.cc:1939] T 80d635ea97464595b8567443de29ff75 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting consensus metadata
I20260812 09:50:30.024308 14386 ts_tablet_manager.cc:1905] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:30.025249 13717 catalog_manager.cc:4841] TS 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461): tablet 80d635ea97464595b8567443de29ff75 (table test-table [id=3a40c6db4432450eb82ff57a32933f5a]) successfully deleted
I20260812 09:50:30.025655 13715 catalog_manager.cc:4841] TS 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595): tablet 80d635ea97464595b8567443de29ff75 (table test-table [id=3a40c6db4432450eb82ff57a32933f5a]) successfully deleted
I20260812 09:50:30.025861 14039 tablet_service.cc:1467] Processing CreateTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 (DEFAULT_TABLE table=test-table [id=8a8c8940451e4423b042c814ae819fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:30.026132 14039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a8ebaa88be34659b7f849b9578c0765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:30.026211 14193 tablet_service.cc:1467] Processing CreateTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 (DEFAULT_TABLE table=test-table [id=8a8c8940451e4423b042c814ae819fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:30.026225 13884 tablet_service.cc:1467] Processing CreateTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 (DEFAULT_TABLE table=test-table [id=8a8c8940451e4423b042c814ae819fa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:30.026461 14193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a8ebaa88be34659b7f849b9578c0765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:30.026467 13884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a8ebaa88be34659b7f849b9578c0765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:30.027036 14386 ts_tablet_manager.cc:1918] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:30.027104 14386 log.cc:1196] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/80d635ea97464595b8567443de29ff75
I20260812 09:50:30.027359 14386 ts_tablet_manager.cc:1939] T 80d635ea97464595b8567443de29ff75 P 21458132248d4591bd24e1af2a5919c9: Deleting consensus metadata
I20260812 09:50:30.028134 13715 catalog_manager.cc:4841] TS 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607): tablet 80d635ea97464595b8567443de29ff75 (table test-table [id=3a40c6db4432450eb82ff57a32933f5a]) successfully deleted
I20260812 09:50:30.028656 14401 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: Bootstrap starting.
I20260812 09:50:30.028988 14400 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Bootstrap starting.
I20260812 09:50:30.029567 14402 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Bootstrap starting.
I20260812 09:50:30.029618 14401 tablet_bootstrap.cc:654] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:30.029832 14400 tablet_bootstrap.cc:654] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:30.030495 14402 tablet_bootstrap.cc:654] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:30.030825 14401 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: No bootstrap required, opened a new log
I20260812 09:50:30.030886 14401 ts_tablet_manager.cc:1397] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 09:50:30.030946 14400 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: No bootstrap required, opened a new log
I20260812 09:50:30.031070 14400 ts_tablet_manager.cc:1397] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260812 09:50:30.031364 14401 raft_consensus.cc:348] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.031482 14401 raft_consensus.cc:374] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:30.031503 14401 raft_consensus.cc:729] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21458132248d4591bd24e1af2a5919c9, State: Initialized, Role: FOLLOWER
I20260812 09:50:30.031528 14400 raft_consensus.cc:348] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.031596 14401 consensus_queue.cc:260] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.031648 14400 raft_consensus.cc:374] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:30.031687 14400 raft_consensus.cc:729] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998f7b3e0a84d15a96f4cf44bb3b7de, State: Initialized, Role: FOLLOWER
I20260812 09:50:30.031790 14402 tablet_bootstrap.cc:492] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: No bootstrap required, opened a new log
I20260812 09:50:30.031852 14401 ts_tablet_manager.cc:1428] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:30.031812 14400 consensus_queue.cc:260] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.031867 14402 ts_tablet_manager.cc:1397] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 09:50:30.032088 14400 ts_tablet_manager.cc:1428] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 09:50:30.032313 14402 raft_consensus.cc:348] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.032464 14402 raft_consensus.cc:374] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:30.032497 14402 raft_consensus.cc:729] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Initialized, Role: FOLLOWER
I20260812 09:50:30.032641 14402 consensus_queue.cc:260] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.032944 14402 ts_tablet_manager.cc:1428] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 09:50:30.088344 14328 raft_consensus.cc:482] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:30.088551 14328 raft_consensus.cc:504] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.088975 14328 leader_election.cc:288] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:30.089570 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a8ebaa88be34659b7f849b9578c0765" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9" is_pre_election: true
I20260812 09:50:30.089769 13904 raft_consensus.cc:2454] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 0.
I20260812 09:50:30.089661 14215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a8ebaa88be34659b7f849b9578c0765" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" is_pre_election: true
I20260812 09:50:30.089903 14215 raft_consensus.cc:2454] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 0.
I20260812 09:50:30.090176 13985 leader_election.cc:302] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 5adea064cde44bf3985c7f69dbff0767; no voters:
I20260812 09:50:30.090377 14328 raft_consensus.cc:2781] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:30.090449 14328 raft_consensus.cc:482] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:30.090477 14328 raft_consensus.cc:3037] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:30.091657 14328 raft_consensus.cc:504] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.092041 14328 leader_election.cc:288] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 election: Requested vote from peers 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607), 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595)
I20260812 09:50:30.092589 13904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a8ebaa88be34659b7f849b9578c0765" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21458132248d4591bd24e1af2a5919c9"
I20260812 09:50:30.092581 14215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a8ebaa88be34659b7f849b9578c0765" candidate_uuid: "5adea064cde44bf3985c7f69dbff0767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de"
I20260812 09:50:30.092729 14215 raft_consensus.cc:3037] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:30.092729 13904 raft_consensus.cc:3037] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:30.093967 14215 raft_consensus.cc:2454] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 1.
I20260812 09:50:30.093968 13904 raft_consensus.cc:2454] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5adea064cde44bf3985c7f69dbff0767 in term 1.
I20260812 09:50:30.094298 13985 leader_election.cc:302] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21458132248d4591bd24e1af2a5919c9, 5adea064cde44bf3985c7f69dbff0767; no voters:
I20260812 09:50:30.094498 14328 raft_consensus.cc:2781] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:30.094592 14328 raft_consensus.cc:686] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 1 LEADER]: Becoming Leader. State: Replica: 5adea064cde44bf3985c7f69dbff0767, State: Running, Role: LEADER
I20260812 09:50:30.094756 14328 consensus_queue.cc:237] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } }
I20260812 09:50:30.096784 13731 catalog_manager.cc:5495] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "5adea064cde44bf3985c7f69dbff0767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5adea064cde44bf3985c7f69dbff0767" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:30.125696 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:30.122361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.11.118.130:33461)
0812 09:50:30.122700 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:30.122711 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:30.122723 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:50:30.122774 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:30.122777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:30.122818 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:30.122913 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:30.123204 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.123747 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.124572 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.124817 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.124931 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:30.125187 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:30.125271 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:30.125352 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:30.125476 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 09:50:30.125532 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":131,"threads_started":1}
I20260812 09:50:30.135582 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:30.132008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:39793 (local address 127.11.118.130:33461)
0812 09:50:30.132142 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:30.132146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:30.132280 (+ 134us) server_negotiation.cc:407] Connection header received
0812 09:50:30.132383 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:30.132386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:30.132427 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:30.132490 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:30.132753 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.133278 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.134504 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.134778 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.134873 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:30.135162 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:30.135234 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:30.135291 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:30.135397 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 09:50:30.135451 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":52}
I20260812 09:50:30.135645 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:30.131784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33461 (local address 127.11.118.130:39793)
0812 09:50:30.132191 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:30.132206 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:30.132309 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:30.132523 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:30.132526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:30.132534 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:30.132668 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:30.132674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.133387 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.133390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:30.134370 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:30.134380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:30.134909 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:30.134912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:30.135025 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:30.135055 (+ 30us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:30.135317 (+ 262us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:30.135323 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 09:50:30.135391 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 09:50:30.135484 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":18,"thread_start_us":128,"threads_started":1}
I20260812 09:50:30.142627 14215 raft_consensus.cc:1261] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Refusing update from remote peer 5adea064cde44bf3985c7f69dbff0767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:30.142627 13904 raft_consensus.cc:1261] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9 [term 1 FOLLOWER]: Refusing update from remote peer 5adea064cde44bf3985c7f69dbff0767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:30.143196 14371 consensus_queue.cc:1035] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6998f7b3e0a84d15a96f4cf44bb3b7de" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:30.143352 14328 consensus_queue.cc:1035] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21458132248d4591bd24e1af2a5919c9" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:50:30.159723 14364 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 09:50:31.719359 13729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:31.719540 13729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:31.722285 13729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2eb9c4ce62f9481d87e7fcbf630e1590: Sending DeleteTablet for 3 replicas of tablet 4a8ebaa88be34659b7f849b9578c0765
I20260812 09:50:31.723064 13884 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:31 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35664
I20260812 09:50:31.723069 14039 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:31 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35558
I20260812 09:50:31.723102 14193 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a8ebaa88be34659b7f849b9578c0765 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:31 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:52368
I20260812 09:50:31.723484 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13814
I20260812 09:50:31.723518 14447 tablet_replica.cc:330] T 4a8ebaa88be34659b7f849b9578c0765 P 21458132248d4591bd24e1af2a5919c9: stopping tablet replica
I20260812 09:50:31.726764 14448 tablet_replica.cc:330] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: stopping tablet replica
I20260812 09:50:31.726948 14448 raft_consensus.cc:2229] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:31.727161 14448 raft_consensus.cc:2258] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:31.727447 14449 tablet_replica.cc:330] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: stopping tablet replica
I20260812 09:50:31.727610 14449 raft_consensus.cc:2229] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:31.727962 14449 raft_consensus.cc:2258] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:31.728878 14449 ts_tablet_manager.cc:1905] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:31.731276 14449 ts_tablet_manager.cc:1918] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 09:50:31.731381 14449 log.cc:1196] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/4a8ebaa88be34659b7f849b9578c0765
I20260812 09:50:31.731684 14449 ts_tablet_manager.cc:1939] T 4a8ebaa88be34659b7f849b9578c0765 P 5adea064cde44bf3985c7f69dbff0767: Deleting consensus metadata
I20260812 09:50:31.731642 14448 ts_tablet_manager.cc:1905] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:31.732715 13717 catalog_manager.cc:4841] TS 5adea064cde44bf3985c7f69dbff0767 (127.11.118.130:33461): tablet 4a8ebaa88be34659b7f849b9578c0765 (table test-table [id=8a8c8940451e4423b042c814ae819fa3]) successfully deleted
I20260812 09:50:31.735474 14448 ts_tablet_manager.cc:1918] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 09:50:31.735625 14448 log.cc:1196] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/4a8ebaa88be34659b7f849b9578c0765
I20260812 09:50:31.735971 14448 ts_tablet_manager.cc:1939] T 4a8ebaa88be34659b7f849b9578c0765 P 6998f7b3e0a84d15a96f4cf44bb3b7de: Deleting consensus metadata
W20260812 09:50:31.736339 13715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:46607 (error 108)
I20260812 09:50:31.736488 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13968
I20260812 09:50:31.738452 13715 catalog_manager.cc:4841] TS 6998f7b3e0a84d15a96f4cf44bb3b7de (127.11.118.131:45595): tablet 4a8ebaa88be34659b7f849b9578c0765 (table test-table [id=8a8c8940451e4423b042c814ae819fa3]) successfully deleted
I20260812 09:50:31.739542 14451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:31.739076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46607 (local address 127.0.0.1:49264)
0812 09:50:31.739369 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:31.739450 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:46607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":118,"threads_started":1}
W20260812 09:50:31.739687 13715 catalog_manager.cc:4584] TS 21458132248d4591bd24e1af2a5919c9 (127.11.118.129:46607): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a8ebaa88be34659b7f849b9578c0765: Network error: Client connection negotiation failed: client connection to 127.11.118.129:46607: connect: Connection refused (error 111)
I20260812 09:50:31.748924 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 14122
I20260812 09:50:31.758905 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 13699
2026-08-12T09:50:31Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6907 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:31 dist-test-slave-2w3w krb5kdc[14454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:31 dist-test-slave-2w3w krb5kdc[14454](info): set up 2 sockets
Aug 12 09:50:31 dist-test-slave-2w3w krb5kdc[14454](info): commencing operation
krb5kdc: starting...
W20260812 09:50:32.920485 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:33.071856 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:34735
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:34735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:33.193259 14468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:33.193589 14468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:33.193635 14468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:33.198031 14468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:33.198119 14468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:33.198140 14468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:33.198158 14468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:33.198174 14468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:33.203961 14468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:34735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:34735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:33.205271 14468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:33.206555 14468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:33.216722 14474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.216786 14476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.216924 14468 server_base.cc:1034] running on GCE node
W20260812 09:50:33.216765 14473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.217759 14468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:33.219051 14468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:33.220243 14468 hybrid_clock.cc:648] HybridClock initialized: now 1786528233220220 us; error 49 us; skew 500 ppm
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:33.223351 14468 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:33.224411 14468 webserver.cc:460] Webserver started at http://127.11.118.190:45927/ using document root <none> and password file <none>
I20260812 09:50:33.225095 14468 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:33.225198 14468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:33.225454 14468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:33.227854 14468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "48214b24b4d2495eb9b36753d88356db"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "88cee238debaad61d520b1e0c4204d83"
server_key_iv: "1ce0413d79be08e440897b9c9eaaf54d"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.228565 14468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "48214b24b4d2495eb9b36753d88356db"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "88cee238debaad61d520b1e0c4204d83"
server_key_iv: "1ce0413d79be08e440897b9c9eaaf54d"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.232848 14468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:33.235534 14483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.236976 14468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:33.237154 14468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "48214b24b4d2495eb9b36753d88356db"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "88cee238debaad61d520b1e0c4204d83"
server_key_iv: "1ce0413d79be08e440897b9c9eaaf54d"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.237289 14468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:33.256453 14468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:33.260138 14468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:33.260389 14468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:33.268297 14468 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:34735
I20260812 09:50:33.268322 14541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:34735 every 8 connection(s)
I20260812 09:50:33.269345 14468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:33.270520 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 14468
I20260812 09:50:33.270637 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:33.270923 11738 external_mini_cluster.cc:1428] Setting key a2e4c812f490874bff0a9bcaee0a67a9
I20260812 09:50:33.272990 14542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:33.280228 14542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db: Bootstrap starting.
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:33.282723 14542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:33.283561 14542 log.cc:824] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:33.286051 14542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db: No bootstrap required, opened a new log
I20260812 09:50:33.286840 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:33.272503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41048 (local address 127.11.118.190:34735)
0812 09:50:33.272966 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:33.272982 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:33.273019 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:50:33.273750 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:33.273770 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:33.274105 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:33.274406 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:33.275480 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.276561 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.277813 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.278356 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.278488 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:33.281629 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:33.281634 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:33.281648 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:33.281682 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:33.283629 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.284216 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.284222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.284228 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.284367 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.284706 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.284708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.284709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.285163 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:33.285308 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:33.285638 (+ 330us) server_negotiation.cc:299] Negotiation successful
0812 09:50:33.286011 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":308,"thread_start_us":166,"threads_started":1}
I20260812 09:50:33.289635 14542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } }
I20260812 09:50:33.289904 14542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:33.290016 14542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48214b24b4d2495eb9b36753d88356db, State: Initialized, Role: FOLLOWER
I20260812 09:50:33.290453 14542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } }
I20260812 09:50:33.290611 14542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:33.290701 14542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:33.290822 14542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:33.291875 14542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } }
I20260812 09:50:33.292227 14542 leader_election.cc:302] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48214b24b4d2495eb9b36753d88356db; no voters:
I20260812 09:50:33.292562 14542 leader_election.cc:288] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:33.292691 14547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:33.292991 14547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [term 1 LEADER]: Becoming Leader. State: Replica: 48214b24b4d2495eb9b36753d88356db, State: Running, Role: LEADER
I20260812 09:50:33.293417 14547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } }
I20260812 09:50:33.293967 14542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:33.295449 14549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48214b24b4d2495eb9b36753d88356db. Latest consensus state: current_term: 1 leader_uuid: "48214b24b4d2495eb9b36753d88356db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } } }
I20260812 09:50:33.295586 14549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:33.295851 14548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48214b24b4d2495eb9b36753d88356db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48214b24b4d2495eb9b36753d88356db" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34735 } } }
I20260812 09:50:33.295953 14548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:33.296681 14557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:33.299542 14557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:33.306329 14557 catalog_manager.cc:1347] Generated new cluster ID: 8a1dd925b9fd4db5968d4e073b7fe2b9
I20260812 09:50:33.306434 14557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:33.322410 14557 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:33.323643 14557 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:33.333801 14557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48214b24b4d2495eb9b36753d88356db: Generated new TSK 0
I20260812 09:50:33.334542 14557 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:33.375319 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:33.491357 14572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:33.491685 14572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:33.491775 14572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:33.496232 14572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:33.496331 14572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:33.496428 14572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:33.501998 14572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:33.503276 14572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:33.504367 14572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:33.515103 14581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.515249 14582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.515158 14584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.515137 14572 server_base.cc:1034] running on GCE node
I20260812 09:50:33.515729 14572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:33.516433 14572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:33.517612 14572 hybrid_clock.cc:648] HybridClock initialized: now 1786528233517596 us; error 33 us; skew 500 ppm
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:33.520812 14572 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:33.521847 14572 webserver.cc:460] Webserver started at http://127.11.118.129:40297/ using document root <none> and password file <none>
I20260812 09:50:33.522477 14572 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:33.522578 14572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:33.522825 14572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:33.525035 14572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "6b426e319d534721a5f8f2db978a582b"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8cbe213c68bd97c07da5534019d0de65"
server_key_iv: "a844ee6d2c3c0dfe8297fd9b1cdbe930"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.525642 14572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "6b426e319d534721a5f8f2db978a582b"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8cbe213c68bd97c07da5534019d0de65"
server_key_iv: "a844ee6d2c3c0dfe8297fd9b1cdbe930"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.529683 14572 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:33.532435 14591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.534024 14572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:33.534199 14572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "6b426e319d534721a5f8f2db978a582b"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8cbe213c68bd97c07da5534019d0de65"
server_key_iv: "a844ee6d2c3c0dfe8297fd9b1cdbe930"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.534333 14572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:33.549573 14572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:33.553256 14572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:33.553493 14572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:33.554143 14572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:33.555075 14572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:33.555148 14572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.555222 14572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:33.555269 14572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.564670 14572 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:43937
I20260812 09:50:33.564693 14715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:43937 every 8 connection(s)
I20260812 09:50:33.565640 14572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:33.573576 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 14572
I20260812 09:50:33.573715 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:33.574079 11738 external_mini_cluster.cc:1428] Setting key a6940b164297bdea578f796a33faf44f
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:33.581707 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:33.567801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54461 (local address 127.11.118.190:34735)
0812 09:50:33.567957 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:33.567962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:33.568800 (+ 838us) server_negotiation.cc:407] Connection header received
0812 09:50:33.570369 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:33.570372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:33.570441 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:33.570568 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:33.571975 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.572540 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.574051 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.574440 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.574602 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:33.577581 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:33.577589 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:33.577594 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:33.577633 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:33.579179 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.579872 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.579875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.579876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.579957 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.580369 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.580371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.580372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.580562 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:33.580637 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:33.581432 (+ 795us) server_negotiation.cc:299] Negotiation successful
0812 09:50:33.581572 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:33.583112 14718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:33.568098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34735 (local address 127.11.118.129:54461)
0812 09:50:33.568624 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:33.568670 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:33.570116 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:33.570774 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:33.570781 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:33.571282 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:33.571802 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:33.571817 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.572694 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.572697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:33.573872 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:33.573886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.574654 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.574658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:33.574913 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:33.575774 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:33.575792 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:33.577369 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:33.579301 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:33.579310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:33.579331 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:33.579759 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:33.580047 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:33.580053 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:33.580058 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:33.580270 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:33.580678 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:33.580688 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:33.581087 (+ 399us) client_negotiation.cc:769] Sending connection context
0812 09:50:33.581339 (+ 252us) client_negotiation.cc:240] Negotiation successful
0812 09:50:33.581781 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":139,"threads_started":1}
I20260812 09:50:33.584515 14716 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34735
I20260812 09:50:33.584782 14716 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:33.585345 14716 heartbeater.cc:511] Master 127.11.118.190:34735 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:33.588168 14504 ts_manager.cc:194] Registered new tserver with Master: 6b426e319d534721a5f8f2db978a582b (127.11.118.129:43937)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:33.589979 14504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:54461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:33.611219 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:33.729492 14722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:33.729794 14722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:33.729843 14722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:33.734405 14722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:33.734490 14722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:33.734591 14722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:33.740694 14722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:33.741997 14722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:33.743124 14722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:33.753408 14730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.753444 14728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.753408 14727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.753798 14722 server_base.cc:1034] running on GCE node
I20260812 09:50:33.754248 14722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:33.755002 14722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:33.756245 14722 hybrid_clock.cc:648] HybridClock initialized: now 1786528233756212 us; error 30 us; skew 500 ppm
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:33.759649 14722 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:33.760548 14722 webserver.cc:460] Webserver started at http://127.11.118.130:34761/ using document root <none> and password file <none>
I20260812 09:50:33.761090 14722 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:33.761152 14722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:33.761323 14722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:33.763562 14722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "23895d2a1c23402bbfe4efa01b904e00"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8e6fd26f06e27dc9a589472cb148ed37"
server_key_iv: "9b8f84d9c3f809509b8bbdeb81711c21"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.764122 14722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "23895d2a1c23402bbfe4efa01b904e00"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8e6fd26f06e27dc9a589472cb148ed37"
server_key_iv: "9b8f84d9c3f809509b8bbdeb81711c21"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.768138 14722 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:33.770951 14738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.772298 14722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:33.772456 14722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "23895d2a1c23402bbfe4efa01b904e00"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "8e6fd26f06e27dc9a589472cb148ed37"
server_key_iv: "9b8f84d9c3f809509b8bbdeb81711c21"
server_key_version: "encryptionkey@0"
I20260812 09:50:33.772575 14722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:33.786810 14722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:33.790762 14722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:33.791074 14722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:33.791774 14722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:33.792907 14722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:33.793002 14722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.793082 14722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:33.793136 14722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:33.803385 14722 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:35937
I20260812 09:50:33.803423 14861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:35937 every 8 connection(s)
I20260812 09:50:33.804391 14722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:33.809433 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 14722
I20260812 09:50:33.809578 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:33.809867 11738 external_mini_cluster.cc:1428] Setting key a445f8452cc857e38fa36d069b62c71d
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:33.822539 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:33.806520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:45185 (local address 127.11.118.190:34735)
0812 09:50:33.806720 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:33.806726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:33.807992 (+ 1266us) server_negotiation.cc:407] Connection header received
0812 09:50:33.809397 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:33.809402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:33.809475 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:33.809589 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:33.811671 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.812424 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.814828 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.815144 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.815236 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:33.818550 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:33.818553 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:33.818555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:33.818583 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:33.820172 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.820768 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.820772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.820774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.820861 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:33.821292 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:33.821296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:33.821298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:33.821507 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:33.821617 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:33.822173 (+ 556us) server_negotiation.cc:299] Negotiation successful
0812 09:50:33.822351 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 09:50:33.823467 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:33.807154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34735 (local address 127.11.118.130:45185)
0812 09:50:33.807754 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:33.807862 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:33.809136 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:33.809801 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:33.809808 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:33.810591 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:33.811440 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:33.811466 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.812628 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.812632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:33.814639 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:33.814656 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:33.815328 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:33.815335 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:33.815606 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:33.816284 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:33.816311 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:33.818340 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:33.820322 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:33.820329 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:33.820347 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:33.820654 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:33.821019 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:33.821023 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:33.821024 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:33.821184 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:33.821620 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:33.821629 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:33.821910 (+ 281us) client_negotiation.cc:769] Sending connection context
0812 09:50:33.822119 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 09:50:33.822501 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":152,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:50:33.825240 14862 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34735
I20260812 09:50:33.825521 14862 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:33.826081 14862 heartbeater.cc:511] Master 127.11.118.190:34735 requested a full tablet report, sending...
I20260812 09:50:33.827384 14504 ts_manager.cc:194] Registered new tserver with Master: 23895d2a1c23402bbfe4efa01b904e00 (127.11.118.130:35937)
I20260812 09:50:33.828289 14504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:45185
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:33.843120 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:33.966120 14868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:33.966416 14868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:33.966463 14868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:33.970628 14868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:33.970701 14868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:33.970813 14868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:33.977166 14868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:33.978253 14868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:33.979296 14868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:33.989630 14875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.989679 14868 server_base.cc:1034] running on GCE node
W20260812 09:50:33.989617 14877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:33.989625 14874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:33.990484 14868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:33.991195 14868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:33.992405 14868 hybrid_clock.cc:648] HybridClock initialized: now 1786528233992386 us; error 33 us; skew 500 ppm
Aug 12 09:50:33 dist-test-slave-2w3w krb5kdc[14454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:33.995642 14868 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:33.996673 14868 webserver.cc:460] Webserver started at http://127.11.118.131:45941/ using document root <none> and password file <none>
I20260812 09:50:33.997244 14868 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:33.997349 14868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:33.997602 14868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:33.999782 14868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "187147f974634104b62702ca09689bb7"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "7a6cec14f1aca64834fdb94ec9d3b9d7"
server_key_iv: "c542a529d5b3399670aa797fe1f8efc1"
server_key_version: "encryptionkey@0"
I20260812 09:50:34.000387 14868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "187147f974634104b62702ca09689bb7"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "7a6cec14f1aca64834fdb94ec9d3b9d7"
server_key_iv: "c542a529d5b3399670aa797fe1f8efc1"
server_key_version: "encryptionkey@0"
I20260812 09:50:34.004189 14868 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:34.006760 14885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:34.008313 14868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:34.008456 14868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "187147f974634104b62702ca09689bb7"
format_stamp: "Formatted at 2026-08-12 09:50:33 on dist-test-slave-2w3w"
server_key: "7a6cec14f1aca64834fdb94ec9d3b9d7"
server_key_iv: "c542a529d5b3399670aa797fe1f8efc1"
server_key_version: "encryptionkey@0"
I20260812 09:50:34.008579 14868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:34.018292 14868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:34.022029 14868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:34.022282 14868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:34.022949 14868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:34.023869 14868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:34.023919 14868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:34.023989 14868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:34.024024 14868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:34.033749 14868 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:33667
I20260812 09:50:34.033888 15012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:33667 every 8 connection(s)
I20260812 09:50:34.034775 14868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:34.041502 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 14868
I20260812 09:50:34.041638 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:34.041934 11738 external_mini_cluster.cc:1428] Setting key 5046c63edb868c621ed79364e3f993fd
Aug 12 09:50:34 dist-test-slave-2w3w krb5kdc[14454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528233, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:34.050662 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:34.036998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:47553 (local address 127.11.118.190:34735)
0812 09:50:34.037175 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:34.037180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:34.038225 (+ 1045us) server_negotiation.cc:407] Connection header received
0812 09:50:34.039701 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:34.039703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:34.039755 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:34.039837 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:34.041221 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:34.042084 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:34.043769 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:34.044019 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:34.044152 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:34.046943 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:34.046946 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:34.046948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:34.047021 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:34.048590 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:34.049170 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:34.049173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:34.049174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:34.049271 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:34.049610 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:34.049612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:34.049613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:34.049811 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:34.049891 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:34.050416 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 09:50:34.050536 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:34.051599 15015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:34.037540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34735 (local address 127.11.118.131:47553)
0812 09:50:34.038037 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:34.038096 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:34.039482 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:34.040047 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:34.040054 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:34.040467 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:34.041010 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:34.041025 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:34.042325 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:34.042329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:34.043635 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:34.043646 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:34.044185 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:34.044188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:34.044448 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:34.045101 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:34.045119 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:34.046765 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:34.048720 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:34.048726 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:34.048748 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:34.049055 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:34.049368 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:34.049371 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:34.049372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:34.049524 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:34.049915 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:34.049920 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:34.050174 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 09:50:34.050351 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 09:50:34.050627 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":122,"threads_started":1}
I20260812 09:50:34.052973 15013 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34735
I20260812 09:50:34.053244 15013 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:34.053767 15013 heartbeater.cc:511] Master 127.11.118.190:34735 requested a full tablet report, sending...
I20260812 09:50:34.055006 14504 ts_manager.cc:194] Registered new tserver with Master: 187147f974634104b62702ca09689bb7 (127.11.118.131:33667)
I20260812 09:50:34.055696 14504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:47553
I20260812 09:50:34.056351 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 09:50:34.072595 14545 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:34.070642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41052 (local address 127.11.118.190:34735)
0812 09:50:34.070829 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:34.070834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:34.071121 (+ 287us) server_negotiation.cc:407] Connection header received
0812 09:50:34.071320 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:34.071323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:34.071369 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:34.071470 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:34.072426 (+ 956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41052: BlockingRecv error: recv got EOF from 127.0.0.1:41052 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:50:34.075738 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 14572
I20260812 09:50:34.083415 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 14722
I20260812 09:50:34.093068 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 14868
I20260812 09:50:34.102253 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 14468
2026-08-12T09:50:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2340 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:34 dist-test-slave-2w3w krb5kdc[15026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:34 dist-test-slave-2w3w krb5kdc[15026](info): set up 2 sockets
Aug 12 09:50:34 dist-test-slave-2w3w krb5kdc[15026](info): commencing operation
krb5kdc: starting...
W20260812 09:50:35.239172 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:35.387547 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44487
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:45929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:44487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:35.506268 15041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:35.506584 15041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:35.506629 15041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:35.510932 15041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:35.511039 15041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:35.511060 15041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:35.511077 15041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:35.511093 15041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:35.516963 15041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:45929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:44487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:35.518178 15041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:35.519308 15041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:35.528555 15047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:35.528581 15049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:35.528581 15046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:35.529444 15041 server_base.cc:1034] running on GCE node
I20260812 09:50:35.530172 15041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:35.531551 15041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:35.532814 15041 hybrid_clock.cc:648] HybridClock initialized: now 1786528235532798 us; error 30 us; skew 500 ppm
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528235, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:35.537236 15041 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:35.538542 15041 webserver.cc:460] Webserver started at http://127.11.118.190:41805/ using document root <none> and password file <none>
I20260812 09:50:35.539371 15041 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:35.539490 15041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:35.539772 15041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:35.542335 15041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "f54edc8ebf7941a5955f716dfa1d6529"
format_stamp: "Formatted at 2026-08-12 09:50:35 on dist-test-slave-2w3w"
server_key: "51c61062eff6fb02e1a918f2731995fa"
server_key_iv: "a5e0d24ff4ec461b64a7261086746787"
server_key_version: "encryptionkey@0"
I20260812 09:50:35.543144 15041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "f54edc8ebf7941a5955f716dfa1d6529"
format_stamp: "Formatted at 2026-08-12 09:50:35 on dist-test-slave-2w3w"
server_key: "51c61062eff6fb02e1a918f2731995fa"
server_key_iv: "a5e0d24ff4ec461b64a7261086746787"
server_key_version: "encryptionkey@0"
I20260812 09:50:35.547646 15041 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:50:35.550414 15057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:35.552060 15041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:35.552240 15041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "f54edc8ebf7941a5955f716dfa1d6529"
format_stamp: "Formatted at 2026-08-12 09:50:35 on dist-test-slave-2w3w"
server_key: "51c61062eff6fb02e1a918f2731995fa"
server_key_iv: "a5e0d24ff4ec461b64a7261086746787"
server_key_version: "encryptionkey@0"
I20260812 09:50:35.552382 15041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:35.580830 15041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:35.584501 15041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:35.584774 15041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:35.593508 15041 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:44487
I20260812 09:50:35.593902 15116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:44487 every 8 connection(s)
I20260812 09:50:35.594702 15041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:35.596493 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15041
I20260812 09:50:35.596644 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:35.596993 11738 external_mini_cluster.cc:1428] Setting key 7bec3a48c5dcd128cb8332d85933bfd0
I20260812 09:50:35.598095 15117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:35.605036 15117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529: Bootstrap starting.
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:35.607549 15117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:35.608539 15117 log.cc:824] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:35.611007 15117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529: No bootstrap required, opened a new log
I20260812 09:50:35.612851 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:35.598451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60802 (local address 127.11.118.190:44487)
0812 09:50:35.598918 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:35.598937 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:35.599025 (+ 88us) server_negotiation.cc:407] Connection header received
0812 09:50:35.599874 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:35.599897 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:35.600314 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:35.600687 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:35.601471 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:35.602984 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:35.603875 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:35.604562 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:35.604722 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:35.607424 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:35.607434 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:35.607453 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:35.607494 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:35.609486 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:35.610007 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:35.610013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:35.610019 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:35.610168 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:35.610452 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:35.610455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:35.610457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:35.611022 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:35.611222 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:35.611576 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 09:50:35.611893 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":136,"threads_started":1}
I20260812 09:50:35.615773 15117 raft_consensus.cc:348] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } }
I20260812 09:50:35.616084 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:50:35.616084 15117 raft_consensus.cc:374] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:35.616170 15117 raft_consensus.cc:729] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f54edc8ebf7941a5955f716dfa1d6529, State: Initialized, Role: FOLLOWER
I20260812 09:50:35.616627 15117 consensus_queue.cc:260] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } }
I20260812 09:50:35.616761 15117 raft_consensus.cc:388] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:35.616852 15117 raft_consensus.cc:482] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:35.616957 15117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:35.617991 15117 raft_consensus.cc:504] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } }
I20260812 09:50:35.618399 15117 leader_election.cc:302] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f54edc8ebf7941a5955f716dfa1d6529; no voters:
I20260812 09:50:35.618809 15117 leader_election.cc:288] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:35.619002 15123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:35.619282 15123 raft_consensus.cc:686] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [term 1 LEADER]: Becoming Leader. State: Replica: f54edc8ebf7941a5955f716dfa1d6529, State: Running, Role: LEADER
I20260812 09:50:35.619647 15123 consensus_queue.cc:237] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } }
I20260812 09:50:35.620227 15117 sys_catalog.cc:564] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:35.620823 15123 sys_catalog.cc:455] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f54edc8ebf7941a5955f716dfa1d6529. Latest consensus state: current_term: 1 leader_uuid: "f54edc8ebf7941a5955f716dfa1d6529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } } }
I20260812 09:50:35.620955 15123 sys_catalog.cc:458] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:35.621347 15125 sys_catalog.cc:455] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f54edc8ebf7941a5955f716dfa1d6529" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f54edc8ebf7941a5955f716dfa1d6529" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44487 } } }
I20260812 09:50:35.621526 15125 sys_catalog.cc:458] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:35.622941 15130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:35.626551 15130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:35.632385 15130 catalog_manager.cc:1347] Generated new cluster ID: 3a6d8648175f4dcc8027be7e2037072f
I20260812 09:50:35.632476 15130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:35.641219 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:35.634877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.11.118.190:44487)
0812 09:50:35.635035 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:35.635041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:35.635567 (+ 526us) server_negotiation.cc:407] Connection header received
0812 09:50:35.635727 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:35.635730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:35.635782 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:35.635857 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:35.636562 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:35.637358 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:35.638603 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:35.638992 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:35.639090 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:35.640111 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:35.640115 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:35.640117 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:35.640710 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:35.640744 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:35.640763 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:35.640850 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:35.640994 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 09:50:35.641061 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 09:50:35.657871 15130 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:35.658857 15130 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:35.664937 15130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f54edc8ebf7941a5955f716dfa1d6529: Generated new TSK 0
I20260812 09:50:35.666157 15130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:50:35.674925 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15041
2026-08-12T09:50:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1570 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15155](info): set up 2 sockets
Aug 12 09:50:35 dist-test-slave-2w3w krb5kdc[15155](info): commencing operation
krb5kdc: starting...
W20260812 09:50:36.808838 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:36 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:36.961056 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37427
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:37.084379 15171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:37.084762 15171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:37.084838 15171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:37.089319 15171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:37.089460 15171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:37.089501 15171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:37.089538 15171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:37.089578 15171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:37.095523 15171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:37.096789 15171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:37.097929 15171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:37.107712 15177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.107764 15180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.107730 15176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:37.108374 15171 server_base.cc:1034] running on GCE node
I20260812 09:50:37.109206 15171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:37.110469 15171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:37.111693 15171 hybrid_clock.cc:648] HybridClock initialized: now 1786528237111666 us; error 44 us; skew 500 ppm
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:37.120680 15171 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:37.121739 15171 webserver.cc:460] Webserver started at http://127.11.118.190:38447/ using document root <none> and password file <none>
I20260812 09:50:37.122377 15171 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:37.122454 15171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:37.122686 15171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:37.124948 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "bef5924199344bd0b0e65c416149c364"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "8a8575db2d56c8a57945465819224898"
server_key_iv: "e0e761d867cf0a025c8f7d59c7439e49"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.125574 15171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "bef5924199344bd0b0e65c416149c364"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "8a8575db2d56c8a57945465819224898"
server_key_iv: "e0e761d867cf0a025c8f7d59c7439e49"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.129786 15171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 09:50:37.132828 15187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.134241 15171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:37.134430 15171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "bef5924199344bd0b0e65c416149c364"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "8a8575db2d56c8a57945465819224898"
server_key_iv: "e0e761d867cf0a025c8f7d59c7439e49"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.134601 15171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:37.160596 15171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:37.164251 15171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:37.164491 15171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:37.172147 15171 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37427
I20260812 09:50:37.172174 15247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37427 every 8 connection(s)
I20260812 09:50:37.173194 15171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:37.176201 15248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:37.181605 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15171
I20260812 09:50:37.181725 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:37.182080 11738 external_mini_cluster.cc:1428] Setting key a0af5ff1077ce28f536f6c72330862b2
I20260812 09:50:37.183714 15248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364: Bootstrap starting.
I20260812 09:50:37.186286 15248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:37.187321 15248 log.cc:824] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:37.190138 15248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364: No bootstrap required, opened a new log
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:37.194644 15248 raft_consensus.cc:348] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } }
I20260812 09:50:37.195035 15248 raft_consensus.cc:374] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:37.195149 15248 raft_consensus.cc:729] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef5924199344bd0b0e65c416149c364, State: Initialized, Role: FOLLOWER
I20260812 09:50:37.195726 15248 consensus_queue.cc:260] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } }
I20260812 09:50:37.195938 15248 raft_consensus.cc:388] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:37.196010 15248 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:37.196136 15248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:37.197628 15248 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } }
I20260812 09:50:37.198074 15248 leader_election.cc:302] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef5924199344bd0b0e65c416149c364; no voters:
I20260812 09:50:37.198460 15248 leader_election.cc:288] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:37.198639 15253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:37.198899 15253 raft_consensus.cc:686] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [term 1 LEADER]: Becoming Leader. State: Replica: bef5924199344bd0b0e65c416149c364, State: Running, Role: LEADER
I20260812 09:50:37.199343 15253 consensus_queue.cc:237] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } }
I20260812 09:50:37.200024 15248 sys_catalog.cc:564] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:37.201359 15255 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bef5924199344bd0b0e65c416149c364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } } }
I20260812 09:50:37.201522 15255 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:37.201784 15255 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bef5924199344bd0b0e65c416149c364. Latest consensus state: current_term: 1 leader_uuid: "bef5924199344bd0b0e65c416149c364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef5924199344bd0b0e65c416149c364" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37427 } } }
I20260812 09:50:37.201876 15255 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:37.202260 15264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:37.203208 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.183805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50024 (local address 127.11.118.190:37427)
0812 09:50:37.184299 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:37.184323 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:37.184360 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:50:37.185051 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:37.185068 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:37.185431 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:37.185724 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:37.186796 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.188230 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.189721 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.190286 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.190755 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.194591 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:37.194599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:37.194624 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:37.194684 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:37.197740 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.198679 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.198688 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.198695 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.198913 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.199406 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.199410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.199412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.200036 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:37.200969 (+ 933us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:37.201177 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 09:50:37.201573 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":154,"threads_started":1}
I20260812 09:50:37.205816 15264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:37.211761 15264 catalog_manager.cc:1347] Generated new cluster ID: 9a264728a2414850ab3964e5f0968cc4
I20260812 09:50:37.211861 15264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:37.224632 15264 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:37.226086 15264 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:37.242709 15264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bef5924199344bd0b0e65c416149c364: Generated new TSK 0
I20260812 09:50:37.243583 15264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:37.287693 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:37.412099 15275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:37.412423 15275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:37.412472 15275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:37.416914 15275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:37.416991 15275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:37.417095 15275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:37.423054 15275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:37.424291 15275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:37.425412 15275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:37.436005 15282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.436007 15281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.436005 15284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:37.436425 15275 server_base.cc:1034] running on GCE node
I20260812 09:50:37.436903 15275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:37.437536 15275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:37.438721 15275 hybrid_clock.cc:648] HybridClock initialized: now 1786528237438688 us; error 50 us; skew 500 ppm
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:37.442059 15275 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:37.443157 15275 webserver.cc:460] Webserver started at http://127.11.118.129:40851/ using document root <none> and password file <none>
I20260812 09:50:37.443758 15275 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:37.443827 15275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:37.444049 15275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:37.446197 15275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "80504ed7dab440f894b550a605c23a19"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "cdc7479a6a8531dcaf7a246c2638d234"
server_key_iv: "3b91649090ccd024e9fed0f704a71689"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.446832 15275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "80504ed7dab440f894b550a605c23a19"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "cdc7479a6a8531dcaf7a246c2638d234"
server_key_iv: "3b91649090ccd024e9fed0f704a71689"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.450954 15275 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260812 09:50:37.453691 15291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.455248 15275 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:37.455374 15275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "80504ed7dab440f894b550a605c23a19"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "cdc7479a6a8531dcaf7a246c2638d234"
server_key_iv: "3b91649090ccd024e9fed0f704a71689"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.455541 15275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:37.467216 15275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:37.470662 15275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:37.470911 15275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:37.471645 15275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:37.472522 15275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:37.472570 15275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.472640 15275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:37.472672 15275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.482070 15275 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:41235
I20260812 09:50:37.482110 15415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:41235 every 8 connection(s)
I20260812 09:50:37.483194 15275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:37.486145 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15275
I20260812 09:50:37.486295 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:37.486658 11738 external_mini_cluster.cc:1428] Setting key e7ed6db040af1bf685500e460c12f81e
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:37.500157 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.485247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:53035 (local address 127.11.118.190:37427)
0812 09:50:37.485405 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:37.485409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:37.486372 (+ 963us) server_negotiation.cc:407] Connection header received
0812 09:50:37.488278 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:37.488281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:37.488340 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:37.488438 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:37.490180 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.490916 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.492179 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.492619 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.492750 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.495841 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:37.495848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:37.495853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:37.495887 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:37.497703 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.498287 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.498292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.498297 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.498394 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.498892 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.498898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.498901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.499160 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:37.499245 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:37.499815 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 09:50:37.500016 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:37.501370 15418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.485567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37427 (local address 127.11.118.129:53035)
0812 09:50:37.486191 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:37.486259 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:37.488001 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:37.488646 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:37.488655 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:37.489245 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:37.489988 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.490011 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.491109 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.491112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.492048 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.492058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.492791 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.492794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.492984 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.493673 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:37.493690 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:37.495634 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:37.497850 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.497855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.497869 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.498163 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.498554 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.498560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.498565 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.498784 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.499260 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:37.499265 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:37.499543 (+ 278us) client_negotiation.cc:769] Sending connection context
0812 09:50:37.499765 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 09:50:37.500291 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:37.503069 15416 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37427
I20260812 09:50:37.503357 15416 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:37.503978 15416 heartbeater.cc:511] Master 127.11.118.190:37427 requested a full tablet report, sending...
I20260812 09:50:37.505775 15205 ts_manager.cc:194] Registered new tserver with Master: 80504ed7dab440f894b550a605c23a19 (127.11.118.129:41235)
I20260812 09:50:37.507082 15205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:53035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:37.523692 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:37.647557 15421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:37.647878 15421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:37.647966 15421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:37.652935 15421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:37.653041 15421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:37.653141 15421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:37.658986 15421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:37.660241 15421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:37.661386 15421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:37.672077 15427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.672031 15432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.672031 15429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:37.672465 15421 server_base.cc:1034] running on GCE node
I20260812 09:50:37.673137 15421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:37.674036 15421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:37.677343 15421 hybrid_clock.cc:648] HybridClock initialized: now 1786528237677252 us; error 105 us; skew 500 ppm
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:37.680506 15421 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:37.681510 15421 webserver.cc:460] Webserver started at http://127.11.118.130:46157/ using document root <none> and password file <none>
I20260812 09:50:37.682072 15421 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:37.682140 15421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:37.682323 15421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:37.684527 15421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "611983d8c62e405baa4c2aa1064a8e56"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "687d757b688b9ed10b4010cb1889b39a"
server_key_iv: "03afaf51216f6e49b8d54d3b20e5c10a"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.685086 15421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "611983d8c62e405baa4c2aa1064a8e56"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "687d757b688b9ed10b4010cb1889b39a"
server_key_iv: "03afaf51216f6e49b8d54d3b20e5c10a"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.689229 15421 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:37.691937 15439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.693415 15421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:37.693523 15421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "611983d8c62e405baa4c2aa1064a8e56"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "687d757b688b9ed10b4010cb1889b39a"
server_key_iv: "03afaf51216f6e49b8d54d3b20e5c10a"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.693681 15421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:37.707940 15421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:37.711354 15421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:37.711570 15421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:37.712198 15421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:37.713047 15421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:37.713095 15421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.713135 15421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:37.713150 15421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.723203 15421 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:37465
I20260812 09:50:37.723219 15566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:37465 every 8 connection(s)
I20260812 09:50:37.724203 15421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:37.732453 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15421
I20260812 09:50:37.732599 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:37.733016 11738 external_mini_cluster.cc:1428] Setting key 42575f5142a1b4fb216a3ae132a399b0
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:37.739868 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.726098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:51443 (local address 127.11.118.190:37427)
0812 09:50:37.726241 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:37.726245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:37.727182 (+ 937us) server_negotiation.cc:407] Connection header received
0812 09:50:37.728527 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:37.728529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:37.728578 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:37.728655 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:37.730036 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.730579 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.731910 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.732128 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.732216 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.735600 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:37.735604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:37.735606 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:37.735632 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:37.737290 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.737913 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.737917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.737924 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.738008 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.738419 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.738422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.738424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.738654 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:37.738788 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:37.739483 (+ 695us) server_negotiation.cc:299] Negotiation successful
0812 09:50:37.739626 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:50:37.740980 15569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.726473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37427 (local address 127.11.118.130:51443)
0812 09:50:37.726954 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:37.727075 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:37.728308 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:37.728901 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:37.728908 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:37.729334 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:37.729868 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.729883 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.730729 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.730732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.731792 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.731803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.732347 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.732353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.732584 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.733310 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:37.733333 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:37.735398 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:37.737442 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.737449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.737469 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.737786 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.738116 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.738120 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.738123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.738300 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.738783 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:37.738791 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:37.739165 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 09:50:37.739421 (+ 256us) client_negotiation.cc:240] Negotiation successful
0812 09:50:37.739813 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":113,"threads_started":1}
I20260812 09:50:37.742220 15567 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37427
I20260812 09:50:37.742509 15567 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:37.743198 15567 heartbeater.cc:511] Master 127.11.118.190:37427 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:37.744489 15205 ts_manager.cc:194] Registered new tserver with Master: 611983d8c62e405baa4c2aa1064a8e56 (127.11.118.130:37465)
I20260812 09:50:37.745126 15205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:51443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:37.767130 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:37.892454 15572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:37.892755 15572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:37.892802 15572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:37.897174 15572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:37.897253 15572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:37.897318 15572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:37.903369 15572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:37.904623 15572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:37.905743 15572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:37.915889 15578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.915868 15581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:37.915868 15579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:37.916225 15572 server_base.cc:1034] running on GCE node
I20260812 09:50:37.916697 15572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:37.917518 15572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:37.918730 15572 hybrid_clock.cc:648] HybridClock initialized: now 1786528237918699 us; error 50 us; skew 500 ppm
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:37.921792 15572 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:37.922817 15572 webserver.cc:460] Webserver started at http://127.11.118.131:45173/ using document root <none> and password file <none>
I20260812 09:50:37.923449 15572 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:37.923516 15572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:37.923689 15572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:37.925748 15572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "fd69bbb7aa604084a732c5bcb72e9996"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "659288092173aa2488877f07716efd1c"
server_key_iv: "d14c19ade02f29539a98e8906269c185"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.926297 15572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "fd69bbb7aa604084a732c5bcb72e9996"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "659288092173aa2488877f07716efd1c"
server_key_iv: "d14c19ade02f29539a98e8906269c185"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.930121 15572 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:37.933141 15588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.934517 15572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:37.934660 15572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "fd69bbb7aa604084a732c5bcb72e9996"
format_stamp: "Formatted at 2026-08-12 09:50:37 on dist-test-slave-2w3w"
server_key: "659288092173aa2488877f07716efd1c"
server_key_iv: "d14c19ade02f29539a98e8906269c185"
server_key_version: "encryptionkey@0"
I20260812 09:50:37.934796 15572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:37.953455 15572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:37.957044 15572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:37.957288 15572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:37.957926 15572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:37.958817 15572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:37.958884 15572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.958940 15572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:37.959018 15572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:37.969199 15572 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:37199
I20260812 09:50:37.969224 15710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:37199 every 8 connection(s)
I20260812 09:50:37.970217 15572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:37.976018 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15572
I20260812 09:50:37.976182 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:37.976532 11738 external_mini_cluster.cc:1428] Setting key 4fb8a2230b59800ea2ad552d5b44d736
Aug 12 09:50:37 dist-test-slave-2w3w krb5kdc[15155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528237, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:37.986368 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.972252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:41339 (local address 127.11.118.190:37427)
0812 09:50:37.972419 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:37.972424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:37.973407 (+ 983us) server_negotiation.cc:407] Connection header received
0812 09:50:37.974850 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:37.974854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:37.974919 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:37.975056 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:37.976530 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.977266 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.979035 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.979406 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.979509 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.982429 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:37.982432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:37.982434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:37.982460 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:37.984165 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.984803 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.984805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.984807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.984901 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:37.985274 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:37.985276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:37.985277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:37.985509 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:37.985588 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:37.986116 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 09:50:37.986233 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 09:50:37.987680 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:37.972613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37427 (local address 127.11.118.131:41339)
0812 09:50:37.973208 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:37.973255 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:37.974597 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:37.975353 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:37.975360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:37.975773 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:37.976361 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.976378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.977421 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.977425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.978822 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:37.978833 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:37.979601 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:37.979605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:37.979770 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:37.980571 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:37.980590 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:37.982222 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:37.984345 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.984353 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.984374 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.984700 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.985002 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:37.985004 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:37.985006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:37.985161 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:37.985617 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:37.985622 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:37.985899 (+ 277us) client_negotiation.cc:769] Sending connection context
0812 09:50:37.986133 (+ 234us) client_negotiation.cc:240] Negotiation successful
0812 09:50:37.986547 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":122,"threads_started":1}
I20260812 09:50:37.989190 15711 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37427
I20260812 09:50:37.989566 15711 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:37.990245 15711 heartbeater.cc:511] Master 127.11.118.190:37427 requested a full tablet report, sending...
I20260812 09:50:37.991460 15205 ts_manager.cc:194] Registered new tserver with Master: fd69bbb7aa604084a732c5bcb72e9996 (127.11.118.131:37199)
I20260812 09:50:37.992039 15205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:41339
I20260812 09:50:38.003352 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 09:50:38 dist-test-slave-2w3w krb5kdc[15155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528238, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 09:50:38 dist-test-slave-2w3w krb5kdc[15155](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528238, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:38.031594 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:38.022402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.11.118.190:37427)
0812 09:50:38.022590 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:38.022594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:38.022647 (+ 53us) server_negotiation.cc:407] Connection header received
0812 09:50:38.022808 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:38.022811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:38.022858 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:38.022943 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:38.023743 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:38.024285 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:38.025192 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:38.025423 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:38.025516 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:38.028255 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:38.028258 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:38.028260 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:38.028288 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:38.029900 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:38.030316 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:38.030319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:38.030320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:38.030394 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:38.030619 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:38.030621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:38.030622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:38.030890 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:38.031076 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:38.031277 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 09:50:38.031386 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 09:50:38.032079 15205 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50032
I20260812 09:50:38.033135 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15275
I20260812 09:50:38.041911 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15421
I20260812 09:50:38.053578 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15572
I20260812 09:50:38.061743 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15171
2026-08-12T09:50:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2388 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:38 dist-test-slave-2w3w krb5kdc[15724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:38 dist-test-slave-2w3w krb5kdc[15724](info): set up 2 sockets
Aug 12 09:50:38 dist-test-slave-2w3w krb5kdc[15724](info): commencing operation
krb5kdc: starting...
W20260812 09:50:39.200214 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:39 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:39.343917 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:32915
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:32915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:39.460573 15740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:39.460877 15740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:39.460920 15740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:39.465019 15740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:39.465101 15740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:39.465121 15740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:39.465138 15740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:39.465155 15740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:39.470844 15740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:32915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:32915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:39.472079 15740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:39.473088 15740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:50:39.482439 15740 server_base.cc:1034] running on GCE node
W20260812 09:50:39.482400 15745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:39.482398 15746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:39.482393 15748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:39.483405 15740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:39.484618 15740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:39.485810 15740 hybrid_clock.cc:648] HybridClock initialized: now 1786528239485801 us; error 48 us; skew 500 ppm
Aug 12 09:50:39 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528239, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:39.488984 15740 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:39.489961 15740 webserver.cc:460] Webserver started at http://127.11.118.190:34457/ using document root <none> and password file <none>
I20260812 09:50:39.490535 15740 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:39.490599 15740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:39.490774 15740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:39.493005 15740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "3f198489e334445799e0ee4b8c2a14d9"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "c13e731f3d9f305e657fdb5fc0d5edd6"
server_key_iv: "c2956f5c42334e662d3ff7368b4c20ab"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.493625 15740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "3f198489e334445799e0ee4b8c2a14d9"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "c13e731f3d9f305e657fdb5fc0d5edd6"
server_key_iv: "c2956f5c42334e662d3ff7368b4c20ab"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.497731 15740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:39.501005 15756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:39.502807 15740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:39.503100 15740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "3f198489e334445799e0ee4b8c2a14d9"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "c13e731f3d9f305e657fdb5fc0d5edd6"
server_key_iv: "c2956f5c42334e662d3ff7368b4c20ab"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.503233 15740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:39.516456 15740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:39.520233 15740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:39.520498 15740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:39.528892 15740 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:32915
I20260812 09:50:39.528925 15814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:32915 every 8 connection(s)
I20260812 09:50:39.530054 15740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:39.532275 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15740
I20260812 09:50:39.532471 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:39.532850 11738 external_mini_cluster.cc:1428] Setting key eb14593517b51a744f55f175eaffc7fc
I20260812 09:50:39.533316 15815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:39.540227 15815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9: Bootstrap starting.
Aug 12 09:50:39 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:39.543140 15815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:39.543970 15815 log.cc:824] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:39.546123 15815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9: No bootstrap required, opened a new log
I20260812 09:50:39.547904 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:39.534480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43938 (local address 127.11.118.190:32915)
0812 09:50:39.535115 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:39.535133 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:39.535174 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:50:39.535874 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:39.535899 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:39.536240 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:39.536604 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:39.537505 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.538551 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.539538 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.540034 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.540226 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:39.542854 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:39.542860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:39.542874 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:39.542916 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:39.544853 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:39.545373 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:39.545378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:39.545385 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:39.545500 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:39.545804 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:39.545808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:39.545810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:39.546276 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:39.546478 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:39.546796 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 09:50:39.547161 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":174,"threads_started":1}
I20260812 09:50:39.550482 15815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } }
I20260812 09:50:39.550765 15815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:39.550853 15815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f198489e334445799e0ee4b8c2a14d9, State: Initialized, Role: FOLLOWER
I20260812 09:50:39.551343 15815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } }
I20260812 09:50:39.551517 15815 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:39.551605 15815 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:39.551707 15815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:39.552809 15815 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } }
I20260812 09:50:39.553167 15815 leader_election.cc:302] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f198489e334445799e0ee4b8c2a14d9; no voters:
I20260812 09:50:39.553534 15815 leader_election.cc:288] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:39.553793 15821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:39.554162 15821 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [term 1 LEADER]: Becoming Leader. State: Replica: 3f198489e334445799e0ee4b8c2a14d9, State: Running, Role: LEADER
I20260812 09:50:39.554531 15821 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } }
I20260812 09:50:39.555080 15815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:39.556286 15823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f198489e334445799e0ee4b8c2a14d9. Latest consensus state: current_term: 1 leader_uuid: "3f198489e334445799e0ee4b8c2a14d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } } }
I20260812 09:50:39.556447 15823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:39.556824 15822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f198489e334445799e0ee4b8c2a14d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f198489e334445799e0ee4b8c2a14d9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32915 } } }
I20260812 09:50:39.556887 15830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:39.557091 15822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:39.560252 15830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:39.566677 15830 catalog_manager.cc:1347] Generated new cluster ID: 38690d111fd740dea83bdccba21b99b7
I20260812 09:50:39.566777 15830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:39.580902 15830 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:39.582267 15830 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:39.589746 15830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f198489e334445799e0ee4b8c2a14d9: Generated new TSK 0
I20260812 09:50:39.590692 15830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:39.635494 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:39.779981 15843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:39.780282 15843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:39.780328 15843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:39.784691 15843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:39.784770 15843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:39.784864 15843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:39.790719 15843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:39.791953 15843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:39.793022 15843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:39.803064 15850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:39.803143 15852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:39.803069 15849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:39.803681 15843 server_base.cc:1034] running on GCE node
I20260812 09:50:39.804144 15843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:39.804840 15843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:39.806031 15843 hybrid_clock.cc:648] HybridClock initialized: now 1786528239806009 us; error 34 us; skew 500 ppm
Aug 12 09:50:39 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528239, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:39.809231 15843 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:39.810307 15843 webserver.cc:460] Webserver started at http://127.11.118.129:34735/ using document root <none> and password file <none>
I20260812 09:50:39.810950 15843 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:39.811105 15843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:39.811352 15843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:39.813483 15843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "b8b32369d9e649e1b9fe35e97ebc1723"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "5bcbdd7d13b66b8d74237d386de446b8"
server_key_iv: "ff69c430ada42627584362c47c41728a"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.814069 15843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "b8b32369d9e649e1b9fe35e97ebc1723"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "5bcbdd7d13b66b8d74237d386de446b8"
server_key_iv: "ff69c430ada42627584362c47c41728a"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.817942 15843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:50:39.820657 15862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:39.822165 15843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:39.822324 15843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "b8b32369d9e649e1b9fe35e97ebc1723"
format_stamp: "Formatted at 2026-08-12 09:50:39 on dist-test-slave-2w3w"
server_key: "5bcbdd7d13b66b8d74237d386de446b8"
server_key_iv: "ff69c430ada42627584362c47c41728a"
server_key_version: "encryptionkey@0"
I20260812 09:50:39.822455 15843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:39.843233 15843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:39.846632 15843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:39.846855 15843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:39.847517 15843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:39.848371 15843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:39.848461 15843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:39.848555 15843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:39.848608 15843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:39.858338 15843 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38575
I20260812 09:50:39.858367 15984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38575 every 8 connection(s)
I20260812 09:50:39.859318 15843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:39.864629 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15843
I20260812 09:50:39.864764 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:39.865126 11738 external_mini_cluster.cc:1428] Setting key 71e1f757399c41a75e09571247ce6c92
Aug 12 09:50:39 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528239, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:39.876415 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:39.861288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:48067 (local address 127.11.118.190:32915)
0812 09:50:39.861458 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:39.861461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:39.862342 (+ 881us) server_negotiation.cc:407] Connection header received
0812 09:50:39.864017 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:39.864021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:39.864089 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:39.864202 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:39.865777 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.866491 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.867878 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.868130 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.868254 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:39.871513 (+ 3259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:39.871520 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:39.871526 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:39.871566 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:39.873753 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:39.874458 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:39.874462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:39.874464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:39.874570 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:39.875009 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:39.875013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:39.875015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:39.875298 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:39.875416 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:39.876019 (+ 603us) server_negotiation.cc:299] Negotiation successful
0812 09:50:39.876179 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:39.877269 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:39.861677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:32915 (local address 127.11.118.129:48067)
0812 09:50:39.862173 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:39.862218 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:39.863753 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:39.864400 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:39.864410 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:39.864894 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:39.865491 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:39.865506 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.866639 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.866643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:39.867722 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:39.867733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:39.868308 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:39.868313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:39.868498 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:39.869264 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:39.869293 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:39.871279 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:39.873934 (+ 2655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:39.873941 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:39.873963 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:39.874311 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:39.874675 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:39.874677 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:39.874678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:39.874842 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:39.875412 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:39.875418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:39.875720 (+ 302us) client_negotiation.cc:769] Sending connection context
0812 09:50:39.875894 (+ 174us) client_negotiation.cc:240] Negotiation successful
0812 09:50:39.876202 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":123,"threads_started":1}
I20260812 09:50:39.878772 15985 heartbeater.cc:347] Connected to a master server at 127.11.118.190:32915
I20260812 09:50:39.879086 15985 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:39.879709 15985 heartbeater.cc:511] Master 127.11.118.190:32915 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:39.881312 15776 ts_manager.cc:194] Registered new tserver with Master: b8b32369d9e649e1b9fe35e97ebc1723 (127.11.118.129:38575)
I20260812 09:50:39.882515 15776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:48067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:39.899215 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:40.019066 15992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:40.019371 15992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:40.019445 15992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:40.023839 15992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:40.023913 15992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:40.024019 15992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:40.029983 15992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:40.031273 15992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:40.032366 15992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:40.042639 16001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:40.042629 15998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:40.042632 15992 server_base.cc:1034] running on GCE node
W20260812 09:50:40.042651 15997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:40.043430 15992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:40.044131 15992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:40.045312 15992 hybrid_clock.cc:648] HybridClock initialized: now 1786528240045289 us; error 56 us; skew 500 ppm
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:40.048319 15992 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:40.049284 15992 webserver.cc:460] Webserver started at http://127.11.118.130:45937/ using document root <none> and password file <none>
I20260812 09:50:40.049860 15992 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:40.049921 15992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:40.050148 15992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:40.052376 15992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "fff78bdd18fd4c09a84620ed58b8cc59"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "54ec444278da9015800c6abfa9982243"
server_key_iv: "6bca90c7e069cd93aad393c74066e453"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.053020 15992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "fff78bdd18fd4c09a84620ed58b8cc59"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "54ec444278da9015800c6abfa9982243"
server_key_iv: "6bca90c7e069cd93aad393c74066e453"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.057500 15992 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:40.060222 16008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.061740 15992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:40.061905 15992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "fff78bdd18fd4c09a84620ed58b8cc59"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "54ec444278da9015800c6abfa9982243"
server_key_iv: "6bca90c7e069cd93aad393c74066e453"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.062036 15992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:40.086226 15992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:40.090286 15992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:40.090515 15992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:40.091256 15992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:40.092181 15992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:40.092258 15992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.092327 15992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:40.092360 15992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.101624 15992 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:46841
I20260812 09:50:40.101648 16128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:46841 every 8 connection(s)
I20260812 09:50:40.102576 15992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:40.108204 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 15992
I20260812 09:50:40.108346 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:40.108678 11738 external_mini_cluster.cc:1428] Setting key 7ec66e6852f0ba3faa26409583b20869
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:40.119354 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.104578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:51237 (local address 127.11.118.190:32915)
0812 09:50:40.104761 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:40.104765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:40.105636 (+ 871us) server_negotiation.cc:407] Connection header received
0812 09:50:40.107101 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:40.107105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:40.107163 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:40.107240 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:40.108802 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.109444 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.110999 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.111404 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.111538 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.114823 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:40.114826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:40.114829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:40.114884 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:40.116657 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.117412 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.117415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.117422 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.117503 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.118002 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.118006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.118007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.118222 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:40.118309 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:40.119099 (+ 790us) server_negotiation.cc:299] Negotiation successful
0812 09:50:40.119215 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:40.120620 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.104989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:32915 (local address 127.11.118.130:51237)
0812 09:50:40.105471 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:40.105517 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:40.106812 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:40.107417 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:40.107424 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:40.107810 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:40.108598 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:40.108622 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.109597 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.109600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:40.110815 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:40.110825 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.111605 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.111609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:40.111783 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.112554 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:40.112583 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:40.114613 (+ 2030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:40.116812 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:40.116823 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:40.116845 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:40.117291 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:40.117611 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:40.117617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:40.117622 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:40.117857 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:40.118347 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:40.118355 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:40.118729 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 09:50:40.119024 (+ 295us) client_negotiation.cc:240] Negotiation successful
0812 09:50:40.119423 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":125,"threads_started":1}
I20260812 09:50:40.122145 16129 heartbeater.cc:347] Connected to a master server at 127.11.118.190:32915
I20260812 09:50:40.122467 16129 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:40.123045 16129 heartbeater.cc:511] Master 127.11.118.190:32915 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:50:40.124321 15776 ts_manager.cc:194] Registered new tserver with Master: fff78bdd18fd4c09a84620ed58b8cc59 (127.11.118.130:46841)
I20260812 09:50:40.124962 15776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:51237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:40.147169 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:40.266629 16134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:40.267015 16134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:40.267098 16134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:40.271396 16134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:40.271525 16134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:40.271625 16134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:40.277328 16134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:32915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:40.278575 16134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:40.279820 16134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:40.290583 16140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:40.290692 16134 server_base.cc:1034] running on GCE node
W20260812 09:50:40.290586 16143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:40.290586 16141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:40.291410 16134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:40.292164 16134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:40.293357 16134 hybrid_clock.cc:648] HybridClock initialized: now 1786528240293321 us; error 51 us; skew 500 ppm
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:40.296626 16134 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:40.297581 16134 webserver.cc:460] Webserver started at http://127.11.118.131:34045/ using document root <none> and password file <none>
I20260812 09:50:40.298166 16134 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:40.298229 16134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:40.298482 16134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:40.300704 16134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "bb8e3b02fe7148b794b62974177ed02c"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "efcc74d8d073ff1d6d360c7dfd974f61"
server_key_iv: "d3443554e0f65f1bdec996bfbf3d64c5"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.301323 16134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "bb8e3b02fe7148b794b62974177ed02c"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "efcc74d8d073ff1d6d360c7dfd974f61"
server_key_iv: "d3443554e0f65f1bdec996bfbf3d64c5"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.305546 16134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:40.308888 16150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.310359 16134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:40.310649 16134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "bb8e3b02fe7148b794b62974177ed02c"
format_stamp: "Formatted at 2026-08-12 09:50:40 on dist-test-slave-2w3w"
server_key: "efcc74d8d073ff1d6d360c7dfd974f61"
server_key_iv: "d3443554e0f65f1bdec996bfbf3d64c5"
server_key_version: "encryptionkey@0"
I20260812 09:50:40.310799 16134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:40.337216 16134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:40.341311 16134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:40.341554 16134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:40.342286 16134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:40.343256 16134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:40.343331 16134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.343402 16134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:40.343452 16134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:40.354261 16134 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:33305
I20260812 09:50:40.354281 16275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:33305 every 8 connection(s)
I20260812 09:50:40.355509 16134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:40.365837 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16134
I20260812 09:50:40.366348 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:40.366742 11738 external_mini_cluster.cc:1428] Setting key c5e65ef2fa59d537471c2657d7bd654b
I20260812 09:50:40.372008 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.357725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:47557 (local address 127.11.118.190:32915)
0812 09:50:40.357888 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:40.357893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:40.358905 (+ 1012us) server_negotiation.cc:407] Connection header received
0812 09:50:40.360391 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:40.360419 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:40.360490 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:40.360577 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:40.361849 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.362415 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.363669 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.364037 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.364130 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.367508 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:40.367511 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:40.367514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:40.367543 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:40.369322 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.370046 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.370049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.370050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.370257 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.370724 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.370727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.370728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.371052 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:40.371146 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:40.371714 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 09:50:40.371839 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:50:40.372956 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.358266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:32915 (local address 127.11.118.131:47557)
0812 09:50:40.358745 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:40.358790 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:40.360154 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:40.360763 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:40.360770 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:40.361158 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:40.361652 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:40.361666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.362541 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.362544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:40.363499 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:40.363508 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.364201 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.364204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:40.364357 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.365186 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:40.365203 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:40.367300 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:40.369479 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:40.369485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:40.369500 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:40.369935 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:40.370367 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:40.370370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:40.370371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:40.370548 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:40.371170 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:40.371176 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:40.371458 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 09:50:40.371624 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 09:50:40.371915 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":129,"threads_started":1}
I20260812 09:50:40.374253 16277 heartbeater.cc:347] Connected to a master server at 127.11.118.190:32915
I20260812 09:50:40.374470 16277 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:40.375041 16277 heartbeater.cc:511] Master 127.11.118.190:32915 requested a full tablet report, sending...
I20260812 09:50:40.376427 15776 ts_manager.cc:194] Registered new tserver with Master: bb8e3b02fe7148b794b62974177ed02c (127.11.118.131:33305)
I20260812 09:50:40.377061 15776 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:47557
I20260812 09:50:40.381894 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:40.482936 16285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.471105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.11.118.129:38575)
0812 09:50:40.471613 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:40.471624 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:40.471656 (+ 32us) server_negotiation.cc:407] Connection header received
0812 09:50:40.471724 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:40.471734 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:40.471993 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:40.472177 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:40.473066 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.474460 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.475449 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.475910 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.476005 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.478762 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:40.478772 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:40.478787 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:40.478818 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:40.480879 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.481388 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.481393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.481394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.481517 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.481821 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.481827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.481832 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.482158 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:40.482334 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:40.482634 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 09:50:40.482787 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":97,"threads_started":1}
Aug 12 09:50:40 dist-test-slave-2w3w krb5kdc[15724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528240, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:40.495788 15818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:40.486411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43940 (local address 127.11.118.190:32915)
0812 09:50:40.486652 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:40.486656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:40.486672 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:50:40.486840 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:40.486844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:40.486893 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:40.487053 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:40.487832 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.488404 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.489249 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:40.489479 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:40.489563 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:40.492437 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:40.492441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:40.492443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:40.492475 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:40.493950 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.494398 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.494401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.494402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.494491 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:40.494773 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:40.494776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:40.494777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:40.495101 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:40.495211 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:40.495485 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 09:50:40.495588 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
W20260812 09:50:40.496218 15776 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43940
I20260812 09:50:40.496937 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15843
I20260812 09:50:40.510558 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15992
I20260812 09:50:40.520812 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16134
I20260812 09:50:40.530087 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 15740
2026-08-12T09:50:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2468 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:41 dist-test-slave-2w3w krb5kdc[16290](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:41 dist-test-slave-2w3w krb5kdc[16290](info): set up 2 sockets
Aug 12 09:50:41 dist-test-slave-2w3w krb5kdc[16290](info): commencing operation
krb5kdc: starting...
W20260812 09:50:42.973937 11738 mini_kdc.cc:121] Time spent starting KDC: real 2.417s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:43.123720 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37839
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:43.250546 16305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:43.250936 16305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:43.251070 16305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:43.255633 16305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:43.255771 16305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:43.255815 16305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:43.255859 16305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:43.255893 16305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:43.261852 16305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:43.263166 16305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:43.264297 16305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:43.273407 16311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:43.273392 16310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:43.273468 16305 server_base.cc:1034] running on GCE node
W20260812 09:50:43.273392 16313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:43.274382 16305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:43.275712 16305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:43.276932 16305 hybrid_clock.cc:648] HybridClock initialized: now 1786528243276906 us; error 43 us; skew 500 ppm
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:43.284922 16305 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:43.285866 16305 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:43.285979 16305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:43.286252 16305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:43.288699 16305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "1307cbf5e28e403f9180f105fa712da5"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "4df5dd5f934478e7e0b393cb71190952"
server_key_iv: "11bc34c8a9326901dc78fcf3767f0376"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.289351 16305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "1307cbf5e28e403f9180f105fa712da5"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "4df5dd5f934478e7e0b393cb71190952"
server_key_iv: "11bc34c8a9326901dc78fcf3767f0376"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.293552 16305 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:43.296480 16320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.298029 16305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:43.298206 16305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "1307cbf5e28e403f9180f105fa712da5"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "4df5dd5f934478e7e0b393cb71190952"
server_key_iv: "11bc34c8a9326901dc78fcf3767f0376"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.298350 16305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:43.309700 16305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:43.313340 16305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:43.313586 16305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:43.321034 16305 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37839
I20260812 09:50:43.321321 16378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37839 every 8 connection(s)
I20260812 09:50:43.321780 16305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:43.322203 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16305
I20260812 09:50:43.322386 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:43.322685 11738 external_mini_cluster.cc:1428] Setting key 67dff775b96e52cdca99b9e15b332378
I20260812 09:50:43.325064 16379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:43.332458 16379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: Bootstrap starting.
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:43.335134 16379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:43.335916 16379 log.cc:824] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:43.338275 16379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: No bootstrap required, opened a new log
I20260812 09:50:43.338884 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:43.324299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49734 (local address 127.11.118.190:37839)
0812 09:50:43.324772 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:43.324789 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:43.324825 (+ 36us) server_negotiation.cc:407] Connection header received
0812 09:50:43.325582 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:43.325600 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:43.325935 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:43.326227 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:43.327244 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.328436 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.329630 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.330192 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.330328 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:43.333629 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:43.333634 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:43.333648 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:43.333683 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:43.335753 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.336306 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.336315 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.336322 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.336488 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.336796 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.336799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.336800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.337221 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:43.337368 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:43.337730 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 09:50:43.338054 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":164,"threads_started":1}
I20260812 09:50:43.342427 16379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } }
I20260812 09:50:43.342707 16379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:43.342800 16379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1307cbf5e28e403f9180f105fa712da5, State: Initialized, Role: FOLLOWER
I20260812 09:50:43.343341 16379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } }
I20260812 09:50:43.343478 16379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:43.343568 16379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:43.343669 16379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:43.344727 16379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } }
I20260812 09:50:43.345098 16379 leader_election.cc:302] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1307cbf5e28e403f9180f105fa712da5; no voters:
I20260812 09:50:43.345453 16379 leader_election.cc:288] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:43.345666 16385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:43.345985 16385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [term 1 LEADER]: Becoming Leader. State: Replica: 1307cbf5e28e403f9180f105fa712da5, State: Running, Role: LEADER
I20260812 09:50:43.346352 16385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } }
I20260812 09:50:43.346766 16379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:43.348340 16386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1307cbf5e28e403f9180f105fa712da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } } }
I20260812 09:50:43.348495 16386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:43.348728 16387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1307cbf5e28e403f9180f105fa712da5. Latest consensus state: current_term: 1 leader_uuid: "1307cbf5e28e403f9180f105fa712da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1307cbf5e28e403f9180f105fa712da5" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37839 } } }
I20260812 09:50:43.348929 16395 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:43.348930 16387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:43.352279 16395 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:43.359145 16395 catalog_manager.cc:1347] Generated new cluster ID: 34ab573d7fc147a281f1245009d0517f
I20260812 09:50:43.359246 16395 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:43.376991 16395 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:43.378074 16395 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:43.382047 16395 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: Generated new TSK 0
I20260812 09:50:43.382822 16395 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:43.423624 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:43.548533 16407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:43.548939 16407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:43.549028 16407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:43.553227 16407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:43.553321 16407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:43.553414 16407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:43.559145 16407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:43.560355 16407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:43.561450 16407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:43.571838 16413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:43.571915 16416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:43.571861 16414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:43.572276 16407 server_base.cc:1034] running on GCE node
I20260812 09:50:43.572744 16407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:43.573463 16407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:43.574684 16407 hybrid_clock.cc:648] HybridClock initialized: now 1786528243574624 us; error 74 us; skew 500 ppm
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:43.577822 16407 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:43.578714 16407 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:43.578786 16407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:43.579047 16407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:43.581393 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "eb4e96927d85487c8a7b02b7082687e3"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "0a0032e8d90c9f1b6e015a6617f76b0a"
server_key_iv: "b26c213128c2a411800214d03d0ed3e1"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.582223 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "eb4e96927d85487c8a7b02b7082687e3"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "0a0032e8d90c9f1b6e015a6617f76b0a"
server_key_iv: "b26c213128c2a411800214d03d0ed3e1"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.587107 16407 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260812 09:50:43.590046 16422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.591769 16407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:43.591956 16407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "eb4e96927d85487c8a7b02b7082687e3"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "0a0032e8d90c9f1b6e015a6617f76b0a"
server_key_iv: "b26c213128c2a411800214d03d0ed3e1"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.592098 16407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:43.625339 16407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:43.630242 16407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:43.630555 16407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:43.631357 16407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:43.632524 16407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:43.632594 16407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.632684 16407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:43.632718 16407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.642622 16407 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:33997
I20260812 09:50:43.642639 16551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:33997 every 8 connection(s)
I20260812 09:50:43.643273 16407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:43.652866 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16407
I20260812 09:50:43.652992 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:43.653306 11738 external_mini_cluster.cc:1428] Setting key 202a18c2f326b531442b704c3ddd4120
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:43.658581 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:43.645220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:40613 (local address 127.11.118.190:37839)
0812 09:50:43.645381 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:43.645385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:43.646253 (+ 868us) server_negotiation.cc:407] Connection header received
0812 09:50:43.647752 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:43.647756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:43.647819 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:43.647905 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:43.649191 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.649742 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.650930 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.651225 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.651347 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:43.654184 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:43.654187 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:43.654190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:43.654215 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:43.655989 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.656677 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.656683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.656687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.656778 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.657236 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.657242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.657245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.657519 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:43.657592 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:43.658188 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 09:50:43.658368 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 09:50:43.659384 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:43.645607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37839 (local address 127.11.118.129:40613)
0812 09:50:43.646093 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:43.646138 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:43.647497 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:43.648123 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:43.648130 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:43.648517 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:43.649029 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:43.649042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.649876 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.649880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:43.650793 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:43.650803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.651394 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.651398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:43.651576 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:43.652231 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:43.652248 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:43.653988 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:43.656124 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:43.656133 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:43.656155 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:43.656564 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:43.656880 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:43.656886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:43.656891 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:43.657101 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:43.657665 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:43.657670 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:43.657928 (+ 258us) client_negotiation.cc:769] Sending connection context
0812 09:50:43.658093 (+ 165us) client_negotiation.cc:240] Negotiation successful
0812 09:50:43.658368 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":135,"threads_started":1}
I20260812 09:50:43.660833 16552 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37839
I20260812 09:50:43.661108 16552 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:43.661744 16552 heartbeater.cc:511] Master 127.11.118.190:37839 requested a full tablet report, sending...
I20260812 09:50:43.663610 16341 ts_manager.cc:194] Registered new tserver with Master: eb4e96927d85487c8a7b02b7082687e3 (127.11.118.129:33997)
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:43.664975 16341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:40613
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:43.688786 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:43.811591 16558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:43.811911 16558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:43.811960 16558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:43.816272 16558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:43.816349 16558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:43.816457 16558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:43.822233 16558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:43.823457 16558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:43.824537 16558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:43.834554 16566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:43.834743 16558 server_base.cc:1034] running on GCE node
W20260812 09:50:43.834932 16564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:43.834561 16563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:43.835481 16558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:43.836184 16558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:43.837383 16558 hybrid_clock.cc:648] HybridClock initialized: now 1786528243837369 us; error 29 us; skew 500 ppm
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:43.840626 16558 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:43.841547 16558 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:43.841647 16558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:43.841899 16558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:43.844134 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "71a9b436cebc412da972c2020303cc5f"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "27bf4bc6855f6d7fc911e7923d1ff268"
server_key_iv: "04a79fd0e0ec512e8442ff2a0e9cf264"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.844743 16558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "71a9b436cebc412da972c2020303cc5f"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "27bf4bc6855f6d7fc911e7923d1ff268"
server_key_iv: "04a79fd0e0ec512e8442ff2a0e9cf264"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.848906 16558 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:43.851613 16574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.852981 16558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 09:50:43.853116 16558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "71a9b436cebc412da972c2020303cc5f"
format_stamp: "Formatted at 2026-08-12 09:50:43 on dist-test-slave-2w3w"
server_key: "27bf4bc6855f6d7fc911e7923d1ff268"
server_key_iv: "04a79fd0e0ec512e8442ff2a0e9cf264"
server_key_version: "encryptionkey@0"
I20260812 09:50:43.853238 16558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:43.868438 16558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:43.871994 16558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:43.872220 16558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:43.872874 16558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:43.873760 16558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:43.873808 16558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.873875 16558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:43.873909 16558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:43.883692 16558 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:41641
I20260812 09:50:43.883687 16707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:41641 every 8 connection(s)
I20260812 09:50:43.884356 16558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:43.887544 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16558
I20260812 09:50:43.887691 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:43.888096 11738 external_mini_cluster.cc:1428] Setting key 0d9561ecaf754755e33bcdb81735d842
Aug 12 09:50:43 dist-test-slave-2w3w krb5kdc[16290](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528243, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:43.901014 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:43.886162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:39895 (local address 127.11.118.190:37839)
0812 09:50:43.886312 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:43.886316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:43.887273 (+ 957us) server_negotiation.cc:407] Connection header received
0812 09:50:43.888987 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:43.888990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:43.889049 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:43.889134 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:43.890891 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.891543 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.893028 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.893278 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.893407 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:43.896543 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:43.896546 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:43.896549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:43.896618 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:43.898279 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.899079 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.899155 (+ 76us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.899159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.899264 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:43.899723 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:43.899726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:43.899728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:43.899955 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:43.900093 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:43.900700 (+ 607us) server_negotiation.cc:299] Negotiation successful
0812 09:50:43.900844 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:43.902027 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:43.886566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37839 (local address 127.11.118.130:39895)
0812 09:50:43.887101 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:43.887149 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:43.888754 (+ 1605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:43.889374 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:43.889386 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:43.889948 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:43.890693 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:43.890719 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.891687 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.891693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:43.892891 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:43.892902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:43.893457 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:43.893461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:43.893655 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:43.894320 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:43.894345 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:43.896312 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:43.898559 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:43.898567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:43.898586 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:43.898904 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:43.899408 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:43.899412 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:43.899416 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:43.899602 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:43.900095 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:43.900105 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:43.900433 (+ 328us) client_negotiation.cc:769] Sending connection context
0812 09:50:43.900637 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 09:50:43.901016 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":123,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:50:43.903471 16708 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37839
I20260812 09:50:43.903744 16708 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:43.904322 16708 heartbeater.cc:511] Master 127.11.118.190:37839 requested a full tablet report, sending...
I20260812 09:50:43.905690 16341 ts_manager.cc:194] Registered new tserver with Master: 71a9b436cebc412da972c2020303cc5f (127.11.118.130:41641)
I20260812 09:50:43.906527 16341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:39895
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:43.923547 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:44.044140 16714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:44.044487 16714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:44.044566 16714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:44.049535 16714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:44.049649 16714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:44.049748 16714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:44.055810 16714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:44.057112 16714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:44.058291 16714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:44.068724 16720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.068724 16721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.068728 16723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.069020 16714 server_base.cc:1034] running on GCE node
I20260812 09:50:44.069584 16714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:44.070317 16714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:44.071506 16714 hybrid_clock.cc:648] HybridClock initialized: now 1786528244071492 us; error 25 us; skew 500 ppm
Aug 12 09:50:44 dist-test-slave-2w3w krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:44.074469 16714 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:44.075274 16714 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:44.075341 16714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:44.075515 16714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:44.077558 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "97f1315d34c54b258b6e91c9dea8f8ad"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "ce699c374e36643f48326dd1ccff59d8"
server_key_iv: "fd4c121a9fe9add7b6011c821d3ce902"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.078092 16714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "97f1315d34c54b258b6e91c9dea8f8ad"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "ce699c374e36643f48326dd1ccff59d8"
server_key_iv: "fd4c121a9fe9add7b6011c821d3ce902"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.082020 16714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:44.084568 16729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.085857 16714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:44.085959 16714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "97f1315d34c54b258b6e91c9dea8f8ad"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "ce699c374e36643f48326dd1ccff59d8"
server_key_iv: "fd4c121a9fe9add7b6011c821d3ce902"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.086053 16714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:44.105291 16714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:44.108978 16714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:44.109146 16714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:44.109751 16714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:44.110608 16714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:44.110657 16714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.110697 16714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:44.110713 16714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.120784 16714 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:39447
I20260812 09:50:44.120802 16854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:39447 every 8 connection(s)
I20260812 09:50:44.121444 16714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:44.121781 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16714
I20260812 09:50:44.121929 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:44.122319 11738 external_mini_cluster.cc:1428] Setting key e443b61d641c4e15621847fbe6d573f2
Aug 12 09:50:44 dist-test-slave-2w3w krb5kdc[16290](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:44.136675 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.123370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:37507 (local address 127.11.118.190:37839)
0812 09:50:44.123532 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.123537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.124937 (+ 1400us) server_negotiation.cc:407] Connection header received
0812 09:50:44.125825 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.125827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.125875 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.125953 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:44.127207 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.127754 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.128914 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.129128 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.129213 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.132208 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:44.132211 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:44.132214 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:44.132241 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:44.134029 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:44.134648 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:44.134651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:44.134652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:44.134756 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:44.135361 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:44.135364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:44.135366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:44.135582 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:44.135738 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.136376 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.136517 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:44.137598 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.123853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37839 (local address 127.11.118.131:37507)
0812 09:50:44.124783 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.124845 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.125613 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.126086 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.126092 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.126479 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:44.127053 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.127070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.127878 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.127880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.128801 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.128810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.129307 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.129310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.129462 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.130033 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:44.130048 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:44.132001 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:44.134182 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:44.134188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:44.134201 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:44.134527 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:44.134953 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:44.134956 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:44.134975 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:44.135227 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:44.135742 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:44.135751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:44.136102 (+ 351us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.136305 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.136715 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":154,"threads_started":1}
I20260812 09:50:44.138715 16855 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37839
I20260812 09:50:44.139102 16855 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:44.139590 16855 heartbeater.cc:511] Master 127.11.118.190:37839 requested a full tablet report, sending...
I20260812 09:50:44.140726 16341 ts_manager.cc:194] Registered new tserver with Master: 97f1315d34c54b258b6e91c9dea8f8ad (127.11.118.131:39447)
I20260812 09:50:44.141410 16341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:37507
I20260812 09:50:44.149045 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:44.160449 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.151285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49742 (local address 127.11.118.190:37839)
0812 09:50:44.151449 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.151455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.151639 (+ 184us) server_negotiation.cc:407] Connection header received
0812 09:50:44.151864 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.151866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.151912 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.152004 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:44.152787 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.153330 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.154198 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.154436 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.154553 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.156133 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:44.156137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:44.156140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:44.156173 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:44.158100 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:44.158661 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:44.158666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:44.158668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:44.158762 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:44.159149 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:44.159152 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:44.159154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:44.159427 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:44.159581 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.160078 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.160229 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:50:44.164129 16341 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:44.167320 16341 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:44.183378 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.176916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49176 (local address 127.11.118.129:33997)
0812 09:50:44.177399 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.177407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.178055 (+ 648us) server_negotiation.cc:407] Connection header received
0812 09:50:44.178564 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.178570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.178771 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.178890 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:44.179348 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180451 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.182008 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.182575 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.182724 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.182880 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.183077 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.183208 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":159,"threads_started":1}
I20260812 09:50:44.183485 16869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.177234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:39447 (local address 127.0.0.1:38618)
0812 09:50:44.177902 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.177915 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.177992 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.178884 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.178889 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.178913 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:44.179085 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.179101 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180814 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.180820 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.181937 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.181948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.183001 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.183007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.183097 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.183119 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.183197 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.183325 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"mutex_wait_us":51,"thread_start_us":113,"threads_started":1}
I20260812 09:50:44.183498 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.177938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38618 (local address 127.11.118.131:39447)
0812 09:50:44.178327 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.178341 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.178365 (+ 24us) server_negotiation.cc:407] Connection header received
0812 09:50:44.178443 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.178448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.178716 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.178891 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:44.179215 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180471 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.182075 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.182832 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.183023 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.183131 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.183225 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.183323 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":149,"threads_started":1}
I20260812 09:50:44.183785 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.177501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44456 (local address 127.11.118.130:41641)
0812 09:50:44.178487 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.178502 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.178528 (+ 26us) server_negotiation.cc:407] Connection header received
0812 09:50:44.178595 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.178599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.178757 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.178898 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:44.179394 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180134 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.181962 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.182807 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.182952 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.183102 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.183557 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.183658 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":149,"threads_started":1}
I20260812 09:50:44.183929 16871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.176742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:41641 (local address 127.0.0.1:44456)
0812 09:50:44.177686 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.177741 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.177888 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.179059 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.179062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.179083 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:44.179272 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.179281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180283 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.180289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.181861 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.181868 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.183170 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.183176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.183281 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.183313 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.183386 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.183456 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":129,"spinlock_wait_cycles":2432,"thread_start_us":115,"threads_started":1}
I20260812 09:50:44.185101 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.176742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:33997 (local address 127.0.0.1:49176)
0812 09:50:44.177687 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.177742 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.178389 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.179084 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.179086 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.179097 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:44.179223 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.179233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.180584 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.180587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.181849 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.181861 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.182711 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.182715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.182826 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.182863 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.184889 (+ 2026us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.184961 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":69,"thread_start_us":109,"threads_started":1}
I20260812 09:50:44.187068 16634 tablet_service.cc:1467] Processing CreateTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd (DEFAULT_TABLE table=test-table [id=26f0c22426f84322a3ee732cd2746c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:44.187829 16477 tablet_service.cc:1467] Processing CreateTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd (DEFAULT_TABLE table=test-table [id=26f0c22426f84322a3ee732cd2746c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:44.188278 16634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024b8eea13af44b3851c0ec0a617b7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:44.188848 16477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024b8eea13af44b3851c0ec0a617b7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:44.188634 16783 tablet_service.cc:1467] Processing CreateTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd (DEFAULT_TABLE table=test-table [id=26f0c22426f84322a3ee732cd2746c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:44.189720 16783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 024b8eea13af44b3851c0ec0a617b7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:44.196312 16876 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Bootstrap starting.
I20260812 09:50:44.197093 16875 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Bootstrap starting.
I20260812 09:50:44.197552 16874 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: Bootstrap starting.
I20260812 09:50:44.199546 16874 tablet_bootstrap.cc:654] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:44.199589 16875 tablet_bootstrap.cc:654] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:44.199589 16876 tablet_bootstrap.cc:654] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:44.200498 16874 log.cc:824] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:44.200875 16876 log.cc:824] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:44.201200 16875 log.cc:824] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:44.203449 16876 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: No bootstrap required, opened a new log
I20260812 09:50:44.203449 16875 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: No bootstrap required, opened a new log
I20260812 09:50:44.203684 16876 ts_tablet_manager.cc:1397] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 09:50:44.203684 16875 ts_tablet_manager.cc:1397] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:50:44.208120 16876 raft_consensus.cc:348] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.208477 16876 raft_consensus.cc:374] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:44.208544 16876 raft_consensus.cc:729] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f1315d34c54b258b6e91c9dea8f8ad, State: Initialized, Role: FOLLOWER
I20260812 09:50:44.208925 16875 raft_consensus.cc:348] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.209065 16876 consensus_queue.cc:260] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.209173 16874 tablet_bootstrap.cc:492] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: No bootstrap required, opened a new log
I20260812 09:50:44.209184 16875 raft_consensus.cc:374] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:44.209235 16875 raft_consensus.cc:729] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a9b436cebc412da972c2020303cc5f, State: Initialized, Role: FOLLOWER
I20260812 09:50:44.209403 16874 ts_tablet_manager.cc:1397] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260812 09:50:44.209697 16875 consensus_queue.cc:260] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.209897 16855 heartbeater.cc:503] Master 127.11.118.190:37839 was elected leader, sending a full tablet report...
I20260812 09:50:44.210220 16876 ts_tablet_manager.cc:1428] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:44.210654 16875 ts_tablet_manager.cc:1428] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 09:50:44.211061 16708 heartbeater.cc:503] Master 127.11.118.190:37839 was elected leader, sending a full tablet report...
I20260812 09:50:44.214574 16874 raft_consensus.cc:348] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.214956 16874 raft_consensus.cc:374] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:44.215052 16874 raft_consensus.cc:729] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4e96927d85487c8a7b02b7082687e3, State: Initialized, Role: FOLLOWER
I20260812 09:50:44.215540 16874 consensus_queue.cc:260] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.216485 16552 heartbeater.cc:503] Master 127.11.118.190:37839 was elected leader, sending a full tablet report...
I20260812 09:50:44.216727 16874 ts_tablet_manager.cc:1428] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260812 09:50:44.218983 16881 raft_consensus.cc:482] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:44.219210 16881 raft_consensus.cc:504] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.220300 16881 leader_election.cc:288] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb4e96927d85487c8a7b02b7082687e3 (127.11.118.129:33997), 97f1315d34c54b258b6e91c9dea8f8ad (127.11.118.131:39447)
I20260812 09:50:44.224480 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.220561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:33997 (local address 127.11.118.130:58359)
0812 09:50:44.220691 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.220709 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.220804 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.221077 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.221079 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.221097 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:44.221250 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.221257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.222149 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.222152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.223168 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.223178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.224001 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.224005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.224122 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.224148 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.224235 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.224335 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":2}
I20260812 09:50:44.224519 16870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.220715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58359 (local address 127.11.118.129:33997)
0812 09:50:44.220832 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.220837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.220854 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:44.220903 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.220906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.220953 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.221057 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:44.221372 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.222037 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.223298 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.223858 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.223960 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.224002 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.224288 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.224379 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 09:50:44.224839 16873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.220664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:56393 (local address 127.11.118.131:39447)
0812 09:50:44.220807 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.220812 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.221159 (+ 347us) server_negotiation.cc:407] Connection header received
0812 09:50:44.221264 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.221267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.221333 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.221412 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:44.221685 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.222260 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.223619 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.224143 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.224275 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.224321 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.224588 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.224681 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:50:44.225225 16498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024b8eea13af44b3851c0ec0a617b7cd" candidate_uuid: "71a9b436cebc412da972c2020303cc5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4e96927d85487c8a7b02b7082687e3" is_pre_election: true
I20260812 09:50:44.225580 16498 raft_consensus.cc:2454] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a9b436cebc412da972c2020303cc5f in term 0.
I20260812 09:50:44.226120 16883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.220561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:39447 (local address 127.11.118.130:56393)
0812 09:50:44.221042 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.221056 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.221169 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.221440 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.221443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.221461 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:44.221574 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.221581 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.222416 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.222419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.223464 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:44.223476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.224298 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.224302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:44.224435 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.224458 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.224550 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.225915 (+ 1365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":133,"thread_start_us":130,"threads_started":1}
I20260812 09:50:44.226262 16576 leader_election.cc:302] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a9b436cebc412da972c2020303cc5f, eb4e96927d85487c8a7b02b7082687e3; no voters:
I20260812 09:50:44.226646 16881 raft_consensus.cc:2781] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:44.226776 16881 raft_consensus.cc:482] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:44.226848 16881 raft_consensus.cc:3037] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:44.227183 16805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024b8eea13af44b3851c0ec0a617b7cd" candidate_uuid: "71a9b436cebc412da972c2020303cc5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" is_pre_election: true
I20260812 09:50:44.227546 16805 raft_consensus.cc:2454] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a9b436cebc412da972c2020303cc5f in term 0.
I20260812 09:50:44.228467 16881 raft_consensus.cc:504] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.229010 16881 leader_election.cc:288] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [CANDIDATE]: Term 1 election: Requested vote from peers eb4e96927d85487c8a7b02b7082687e3 (127.11.118.129:33997), 97f1315d34c54b258b6e91c9dea8f8ad (127.11.118.131:39447)
I20260812 09:50:44.229452 16498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024b8eea13af44b3851c0ec0a617b7cd" candidate_uuid: "71a9b436cebc412da972c2020303cc5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4e96927d85487c8a7b02b7082687e3"
I20260812 09:50:44.229568 16805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "024b8eea13af44b3851c0ec0a617b7cd" candidate_uuid: "71a9b436cebc412da972c2020303cc5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f1315d34c54b258b6e91c9dea8f8ad"
I20260812 09:50:44.229694 16805 raft_consensus.cc:3037] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:44.229689 16498 raft_consensus.cc:3037] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:44.231428 16498 raft_consensus.cc:2454] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a9b436cebc412da972c2020303cc5f in term 1.
I20260812 09:50:44.231428 16805 raft_consensus.cc:2454] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a9b436cebc412da972c2020303cc5f in term 1.
I20260812 09:50:44.231997 16575 leader_election.cc:302] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a9b436cebc412da972c2020303cc5f, 97f1315d34c54b258b6e91c9dea8f8ad; no voters:
I20260812 09:50:44.232254 16881 raft_consensus.cc:2781] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:44.232542 16881 raft_consensus.cc:686] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 1 LEADER]: Becoming Leader. State: Replica: 71a9b436cebc412da972c2020303cc5f, State: Running, Role: LEADER
I20260812 09:50:44.232915 16881 consensus_queue.cc:237] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } }
I20260812 09:50:44.236845 16341 catalog_manager.cc:5495] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71a9b436cebc412da972c2020303cc5f (127.11.118.130). New cstate: current_term: 1 leader_uuid: "71a9b436cebc412da972c2020303cc5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a9b436cebc412da972c2020303cc5f" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:44.250442 16872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.245738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44460 (local address 127.11.118.130:41641)
0812 09:50:44.245973 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.245980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.245995 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:44.246085 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.246087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.246142 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.246261 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:44.246571 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.247172 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.248516 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:44.248743 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:44.248896 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:44.249281 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:44.249908 (+ 627us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:44.250011 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.250171 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.250241 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:50:44.257321 16498 raft_consensus.cc:1261] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 1 FOLLOWER]: Refusing update from remote peer 71a9b436cebc412da972c2020303cc5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:44.257486 16805 raft_consensus.cc:1261] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 1 FOLLOWER]: Refusing update from remote peer 71a9b436cebc412da972c2020303cc5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:44.258206 16884 consensus_queue.cc:1035] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4e96927d85487c8a7b02b7082687e3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 33997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:44.258376 16881 consensus_queue.cc:1035] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f1315d34c54b258b6e91c9dea8f8ad" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:44.268270 16890 mvcc.cc:205] Tried to move back new op lower bound from 7317619688469258240 to 7317619688381329408. Current Snapshot: MvccSnapshot[applied={T|T < 7317619688469258240}]
I20260812 09:50:44.277689 16341 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:44.277915 16341 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:44.280757 16341 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1307cbf5e28e403f9180f105fa712da5: Sending DeleteTablet for 3 replicas of tablet 024b8eea13af44b3851c0ec0a617b7cd
I20260812 09:50:44.281793 16634 tablet_service.cc:1514] Processing DeleteTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:44 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:44456
I20260812 09:50:44.281797 16477 tablet_service.cc:1514] Processing DeleteTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:44 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:49176
I20260812 09:50:44.282121 16783 tablet_service.cc:1514] Processing DeleteTablet for tablet 024b8eea13af44b3851c0ec0a617b7cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:44 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:38618
I20260812 09:50:44.282382 16899 tablet_replica.cc:330] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3: stopping tablet replica
I20260812 09:50:44.282382 16898 tablet_replica.cc:330] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: stopping tablet replica
I20260812 09:50:44.282738 16899 raft_consensus.cc:2229] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:44.282790 16898 raft_consensus.cc:2229] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:44.283169 16899 raft_consensus.cc:2258] T 024b8eea13af44b3851c0ec0a617b7cd P eb4e96927d85487c8a7b02b7082687e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:44.283349 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16407
I20260812 09:50:44.286001 16900 tablet_replica.cc:330] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: stopping tablet replica
I20260812 09:50:44.286432 16900 raft_consensus.cc:2229] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:44.286821 16900 raft_consensus.cc:2258] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:44.286935 16898 raft_consensus.cc:2258] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:44.289089 16900 ts_tablet_manager.cc:1905] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:44.289089 16898 ts_tablet_manager.cc:1905] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:44.292553 16898 ts_tablet_manager.cc:1918] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:44.292552 16900 ts_tablet_manager.cc:1918] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:44.292682 16900 log.cc:1196] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/024b8eea13af44b3851c0ec0a617b7cd
I20260812 09:50:44.292682 16898 log.cc:1196] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/024b8eea13af44b3851c0ec0a617b7cd
I20260812 09:50:44.293049 16898 ts_tablet_manager.cc:1939] T 024b8eea13af44b3851c0ec0a617b7cd P 71a9b436cebc412da972c2020303cc5f: Deleting consensus metadata
I20260812 09:50:44.293049 16900 ts_tablet_manager.cc:1939] T 024b8eea13af44b3851c0ec0a617b7cd P 97f1315d34c54b258b6e91c9dea8f8ad: Deleting consensus metadata
I20260812 09:50:44.294601 16324 catalog_manager.cc:4841] TS 71a9b436cebc412da972c2020303cc5f (127.11.118.130:41641): tablet 024b8eea13af44b3851c0ec0a617b7cd (table test-table [id=26f0c22426f84322a3ee732cd2746c05]) successfully deleted
I20260812 09:50:44.294601 16322 catalog_manager.cc:4841] TS 97f1315d34c54b258b6e91c9dea8f8ad (127.11.118.131:39447): tablet 024b8eea13af44b3851c0ec0a617b7cd (table test-table [id=26f0c22426f84322a3ee732cd2746c05]) successfully deleted
W20260812 09:50:44.295392 16323 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:33997 (error 108)
I20260812 09:50:44.295660 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16558
I20260812 09:50:44.296977 16868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.296466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:33997 (local address 127.0.0.1:49188)
0812 09:50:44.296715 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.296856 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:33997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260812 09:50:44.297158 16323 catalog_manager.cc:4584] TS eb4e96927d85487c8a7b02b7082687e3 (127.11.118.129:33997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 024b8eea13af44b3851c0ec0a617b7cd: Network error: Client connection negotiation failed: client connection to 127.11.118.129:33997: connect: Connection refused (error 111)
I20260812 09:50:44.307164 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16714
I20260812 09:50:44.320839 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16305
2026-08-12T09:50:44Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3790 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T09:50:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:44Z Disabled control of system clock
I20260812 09:50:44.359118 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41873
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:40251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:41873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 09:50:44.481854 16905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:44.482180 16905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:44.482221 16905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:44.486660 16905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:44.486735 16905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:44.486754 16905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:44.486771 16905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:44.486788 16905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:44.491905 16905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:41873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:44.493078 16905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:44.494541 16905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:44.504006 16913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.504129 16905 server_base.cc:1034] running on GCE node
W20260812 09:50:44.503984 16915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.503984 16912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.505015 16905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:44.506366 16905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:44.507584 16905 hybrid_clock.cc:648] HybridClock initialized: now 1786528244507554 us; error 48 us; skew 500 ppm
I20260812 09:50:44.509716 16905 webserver.cc:460] Webserver started at http://127.11.118.190:46495/ using document root <none> and password file <none>
I20260812 09:50:44.510358 16905 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:44.510478 16905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:44.510728 16905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:44.513031 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "9476bc17f7034430bfa5ad38266c95e9"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "69fa2e723ede46cb66e86801a6345eac"
server_key_iv: "8b532898a22f43a1c87c6547237a50f0"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.513674 16905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "9476bc17f7034430bfa5ad38266c95e9"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "69fa2e723ede46cb66e86801a6345eac"
server_key_iv: "8b532898a22f43a1c87c6547237a50f0"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.517833 16905 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:44.520565 16922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.521957 16905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:44.522115 16905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "9476bc17f7034430bfa5ad38266c95e9"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "69fa2e723ede46cb66e86801a6345eac"
server_key_iv: "8b532898a22f43a1c87c6547237a50f0"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.522255 16905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:44.527406 16905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:44.528127 16905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:44.528335 16905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:44.536227 16905 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:41873
I20260812 09:50:44.536278 16979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:41873 every 8 connection(s)
I20260812 09:50:44.537384 16905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:44.540860 16980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:44.547223 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 16905
I20260812 09:50:44.547343 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:44.547426 16980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: Bootstrap starting.
I20260812 09:50:44.547686 11738 external_mini_cluster.cc:1428] Setting key 43d0045814f46ce14cc2422b8c1e7486
I20260812 09:50:44.550765 16980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:44.552011 16980 log.cc:824] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:44.554601 16980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: No bootstrap required, opened a new log
I20260812 09:50:44.555492 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.549560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40126 (local address 127.11.118.190:41873)
0812 09:50:44.550348 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.550370 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.550470 (+ 100us) server_negotiation.cc:407] Connection header received
0812 09:50:44.551621 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.551646 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.552162 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.552578 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:44.553510 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:44.553515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:44.553528 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:44.553541 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:44.553603 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:44.553620 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:44.553740 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.553872 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.554486 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":140,"threads_started":1}
I20260812 09:50:44.558928 16980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } }
I20260812 09:50:44.559255 16980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:44.559335 16980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9476bc17f7034430bfa5ad38266c95e9, State: Initialized, Role: FOLLOWER
I20260812 09:50:44.559747 16980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } }
I20260812 09:50:44.559896 16980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:44.559963 16980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:44.560081 16980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:44.561118 16980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } }
I20260812 09:50:44.561539 16980 leader_election.cc:302] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9476bc17f7034430bfa5ad38266c95e9; no voters:
I20260812 09:50:44.561902 16980 leader_election.cc:288] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:44.562117 16987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:44.562569 16987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [term 1 LEADER]: Becoming Leader. State: Replica: 9476bc17f7034430bfa5ad38266c95e9, State: Running, Role: LEADER
I20260812 09:50:44.562924 16987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } }
I20260812 09:50:44.563711 16980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:44.564760 16989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9476bc17f7034430bfa5ad38266c95e9. Latest consensus state: current_term: 1 leader_uuid: "9476bc17f7034430bfa5ad38266c95e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } } }
I20260812 09:50:44.566049 16989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:44.566349 16988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9476bc17f7034430bfa5ad38266c95e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9476bc17f7034430bfa5ad38266c95e9" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41873 } } }
I20260812 09:50:44.566545 16988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9 [sys.catalog]: This master's current role is: LEADER
W20260812 09:50:44.569396 17005 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:50:44.569509 17005 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:50:44.569594 17004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:44.570530 17004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:44.576363 17004 catalog_manager.cc:1347] Generated new cluster ID: c70b20265358420bb0e2f351bf689068
I20260812 09:50:44.576462 17004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:44.593127 17004 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:44.593528 17004 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:44.601781 17004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: Generated new TSK 0
I20260812 09:50:44.602591 17004 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:50:44.615605 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--builtin_ntp_servers=127.11.118.148:40251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 09:50:44.741676 17008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:44.742012 17008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:44.742056 17008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:44.746567 17008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:44.746650 17008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:44.746711 17008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:44.752584 17008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:44.753994 17008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:44.755760 17008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:44.766809 17015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.766803 17014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.766875 17008 server_base.cc:1034] running on GCE node
W20260812 09:50:44.766803 17017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.767688 17008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:44.768443 17008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:44.769659 17008 hybrid_clock.cc:648] HybridClock initialized: now 1786528244769639 us; error 36 us; skew 500 ppm
I20260812 09:50:44.771869 17008 webserver.cc:460] Webserver started at http://127.11.118.129:37335/ using document root <none> and password file <none>
I20260812 09:50:44.772523 17008 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:44.772640 17008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:44.772905 17008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:44.775398 17008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "67d1626a176849bea416ce187a19065d"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4f2dcb638103b2dc0647ae4f09f301ed"
server_key_iv: "b263681f21980505c3a29bab70f07ded"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.776053 17008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "67d1626a176849bea416ce187a19065d"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4f2dcb638103b2dc0647ae4f09f301ed"
server_key_iv: "b263681f21980505c3a29bab70f07ded"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.780241 17008 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:50:44.783012 17023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.784435 17008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:44.784591 17008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "67d1626a176849bea416ce187a19065d"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4f2dcb638103b2dc0647ae4f09f301ed"
server_key_iv: "b263681f21980505c3a29bab70f07ded"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.784729 17008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:44.789628 17008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:44.790365 17008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:44.790598 17008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:44.791319 17008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:44.792634 17008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:44.792738 17008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.792829 17008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:44.792867 17008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.803643 17008 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38739
I20260812 09:50:44.803668 17148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38739 every 8 connection(s)
I20260812 09:50:44.804847 17008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:44.805572 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17008
I20260812 09:50:44.805743 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:44.806087 11738 external_mini_cluster.cc:1428] Setting key 6507e149ab2998f62c6d846523d92bc7
I20260812 09:50:44.808606 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--builtin_ntp_servers=127.11.118.148:40251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 09:50:44.813689 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.807199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47055 (local address 127.11.118.190:41873)
0812 09:50:44.807374 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:44.807378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:44.809011 (+ 1633us) server_negotiation.cc:407] Connection header received
0812 09:50:44.811292 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:44.811296 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:44.811442 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:44.811587 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:44.813040 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:44.813043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:44.813046 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:44.813061 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:44.813086 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:44.813098 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:44.813296 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:44.813482 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 09:50:44.813540 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:50:44.814677 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:44.807813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41873 (local address 127.11.118.129:47055)
0812 09:50:44.808815 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:44.808877 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:44.811036 (+ 2159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:44.811794 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:44.811802 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:44.811911 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:44.812696 (+ 785us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:44.812698 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:44.812745 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:44.812823 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:44.813259 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:44.813278 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:44.813285 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:50:44.813524 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 09:50:44.813796 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":230,"threads_started":1}
I20260812 09:50:44.816385 17149 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41873
I20260812 09:50:44.816692 17149 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:44.817202 17149 heartbeater.cc:511] Master 127.11.118.190:41873 requested a full tablet report, sending...
I20260812 09:50:44.819175 16941 ts_manager.cc:194] Registered new tserver with Master: 67d1626a176849bea416ce187a19065d (127.11.118.129:38739)
W20260812 09:50:44.935909 17152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:44.936255 17152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:44.936303 17152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:44.940725 17152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:44.940809 17152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:44.940871 17152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:44.946448 17152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:44.947746 17152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:44.949234 17152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:44.960134 17163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.960080 17162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:44.960134 17165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:44.960366 17152 server_base.cc:1034] running on GCE node
I20260812 09:50:44.960963 17152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:44.961746 17152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:44.963217 17152 hybrid_clock.cc:648] HybridClock initialized: now 1786528244963020 us; error 54 us; skew 500 ppm
I20260812 09:50:44.966048 17152 webserver.cc:460] Webserver started at http://127.11.118.130:34561/ using document root <none> and password file <none>
I20260812 09:50:44.966758 17152 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:44.966879 17152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:44.967170 17152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:44.969624 17152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "b54110757c604937b643e2e4bbcea365"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4072322e63f032eb5c6c2aeca228186a"
server_key_iv: "87b4bcff952560afc5557c0e2c2d29cc"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.970310 17152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "b54110757c604937b643e2e4bbcea365"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4072322e63f032eb5c6c2aeca228186a"
server_key_iv: "87b4bcff952560afc5557c0e2c2d29cc"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.974555 17152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:44.977589 17172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.979097 17152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:44.979244 17152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "b54110757c604937b643e2e4bbcea365"
format_stamp: "Formatted at 2026-08-12 09:50:44 on dist-test-slave-2w3w"
server_key: "4072322e63f032eb5c6c2aeca228186a"
server_key_iv: "87b4bcff952560afc5557c0e2c2d29cc"
server_key_version: "encryptionkey@0"
I20260812 09:50:44.979389 17152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:44.984431 17152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:44.985512 17152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:44.985743 17152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:44.986451 17152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:44.987530 17152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:44.987607 17152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.987684 17152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:44.987727 17152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:44.998808 17152 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39357
I20260812 09:50:44.998831 17298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39357 every 8 connection(s)
I20260812 09:50:44.999886 17152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:45.006564 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.002000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:45841 (local address 127.11.118.190:41873)
0812 09:50:45.002194 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.002198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.003497 (+ 1299us) server_negotiation.cc:407] Connection header received
0812 09:50:45.004776 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.004780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.004827 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.004930 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.006117 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.006120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.006123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.006137 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.006159 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.006168 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.006276 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.006383 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.006432 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 09:50:45.007423 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17152
I20260812 09:50:45.007527 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:45.007714 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.002394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41873 (local address 127.11.118.130:45841)
0812 09:50:45.003217 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.003263 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.004534 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.005111 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.005119 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.005213 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.005802 (+ 589us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.005803 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.005846 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.005916 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.006257 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.006264 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.006268 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.006407 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.006613 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":139,"threads_started":1}
I20260812 09:50:45.007882 11738 external_mini_cluster.cc:1428] Setting key 6a58180449da18c1764600c688023240
I20260812 09:50:45.009232 17299 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41873
I20260812 09:50:45.009680 17299 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:45.010352 17299 heartbeater.cc:511] Master 127.11.118.190:41873 requested a full tablet report, sending...
I20260812 09:50:45.010437 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--builtin_ntp_servers=127.11.118.148:40251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 09:50:45.011643 16940 ts_manager.cc:194] Registered new tserver with Master: b54110757c604937b643e2e4bbcea365 (127.11.118.130:39357)
W20260812 09:50:45.137111 17302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:45.137415 17302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:45.137458 17302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:45.141779 17302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:45.141863 17302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:45.141953 17302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:45.147038 17302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:45.148262 17302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:45.149752 17302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:45.160295 17307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:45.160295 17308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:45.160257 17310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:45.160720 17302 server_base.cc:1034] running on GCE node
I20260812 09:50:45.161177 17302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:45.161823 17302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:45.163043 17302 hybrid_clock.cc:648] HybridClock initialized: now 1786528245163010 us; error 55 us; skew 500 ppm
I20260812 09:50:45.165359 17302 webserver.cc:460] Webserver started at http://127.11.118.131:36555/ using document root <none> and password file <none>
I20260812 09:50:45.165983 17302 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:45.166052 17302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:45.166296 17302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:45.168716 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "b3a63145fafd41dab53bdd6eab052f3e"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "b2f06c6d4cb1275d0ac289dfff786cbb"
server_key_iv: "265c675cf2372c4b1641bc807c9aef01"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.169489 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "b3a63145fafd41dab53bdd6eab052f3e"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "b2f06c6d4cb1275d0ac289dfff786cbb"
server_key_iv: "265c675cf2372c4b1641bc807c9aef01"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.173642 17302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:50:45.176388 17316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:45.177722 17302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:45.177866 17302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "b3a63145fafd41dab53bdd6eab052f3e"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "b2f06c6d4cb1275d0ac289dfff786cbb"
server_key_iv: "265c675cf2372c4b1641bc807c9aef01"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.178000 17302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:45.183020 17302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:45.183704 17302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:45.183909 17302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:45.184563 17302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:45.185734 17302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:45.185788 17302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:45.185916 17302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:45.185971 17302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:45.196694 17441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:40839 every 8 connection(s)
I20260812 09:50:45.196671 17302 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:40839
I20260812 09:50:45.197757 17302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:45.198478 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17302
I20260812 09:50:45.198639 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:45.198948 11738 external_mini_cluster.cc:1428] Setting key 98da4647669b0d7720e8a3f5d5524691
I20260812 09:50:45.205294 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.200024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:43543 (local address 127.11.118.190:41873)
0812 09:50:45.200194 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.200198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.201657 (+ 1459us) server_negotiation.cc:407] Connection header received
0812 09:50:45.203119 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.203122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.203161 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.203247 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.204669 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.204672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.204674 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.204687 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.204709 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.204717 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.204804 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.205101 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.205150 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:45.206250 17445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.200603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41873 (local address 127.11.118.131:43543)
0812 09:50:45.201484 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.201542 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.202730 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.203575 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.203582 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.203676 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.204361 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.204363 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.204409 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.204485 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.204904 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.204913 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.204919 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.205092 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.205326 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":135,"threads_started":1}
I20260812 09:50:45.207742 17442 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41873
I20260812 09:50:45.208019 17442 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:45.208583 17442 heartbeater.cc:511] Master 127.11.118.190:41873 requested a full tablet report, sending...
I20260812 09:50:45.210062 16940 ts_manager.cc:194] Registered new tserver with Master: b3a63145fafd41dab53bdd6eab052f3e (127.11.118.131:40839)
I20260812 09:50:45.214617 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:45.219632 16984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.217704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.11.118.190:41873)
0812 09:50:45.217886 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.217890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.217926 (+ 36us) server_negotiation.cc:407] Connection header received
0812 09:50:45.218065 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.218067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.218102 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.218173 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.219017 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.219020 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.219022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.219034 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.219055 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.219068 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.219157 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.219374 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.219460 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 09:50:45.223174 16940 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:45.226658 16940 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:45.240139 17456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.237314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40839 (local address 127.0.0.1:56992)
0812 09:50:45.238075 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.238092 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.238186 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.238765 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.238768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.238782 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.239468 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.239473 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.239486 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.239512 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.239920 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.239922 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.239925 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.240000 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.240026 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":94,"threads_started":1}
I20260812 09:50:45.240139 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.236583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38739 (local address 127.0.0.1:46578)
0812 09:50:45.237075 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.237128 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.237238 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.238440 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.238443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.238471 (+ 28us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.239276 (+ 805us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.239277 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.239297 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.239374 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.239763 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.239773 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.239778 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.239888 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.239964 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":85,"threads_started":1}
I20260812 09:50:45.240527 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.237378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50586 (local address 127.11.118.130:39357)
0812 09:50:45.237735 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.237751 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.237867 (+ 116us) server_negotiation.cc:407] Connection header received
0812 09:50:45.237997 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.238004 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.238210 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.238373 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.239797 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.239803 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.239814 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.239826 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.239872 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.239901 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.240001 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.240281 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.240367 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":119,"threads_started":1}
I20260812 09:50:45.240743 17458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.236758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39357 (local address 127.0.0.1:50586)
0812 09:50:45.237774 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.237788 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.237883 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.238382 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.238388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.238470 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.239245 (+ 775us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.239520 (+ 275us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.239535 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.239558 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.240050 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.240054 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.240058 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.240139 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.240182 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"thread_start_us":133,"threads_started":1}
I20260812 09:50:45.240821 17460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.237565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.11.118.131:40839)
0812 09:50:45.238015 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.238027 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.238178 (+ 151us) server_negotiation.cc:407] Connection header received
0812 09:50:45.238281 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.238290 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.238481 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.238620 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.239652 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.239657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.239668 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.239686 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.239741 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.239774 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.239877 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.240604 (+ 727us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.240674 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":136,"threads_started":1}
I20260812 09:50:45.241191 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.236772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46578 (local address 127.11.118.129:38739)
0812 09:50:45.238068 (+ 1296us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.238084 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.238106 (+ 22us) server_negotiation.cc:407] Connection header received
0812 09:50:45.238152 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.238156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.238288 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.238794 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.239544 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.239550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.239563 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.239577 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.239623 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.239660 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.239796 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.240911 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.241036 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1194,"thread_start_us":144,"threads_started":1}
I20260812 09:50:45.243920 17227 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd177b76cf24af88947b59494183951 (DEFAULT_TABLE table=test-table [id=d0657d7c637c4efc844b7e2a928ee17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:45.243952 17073 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd177b76cf24af88947b59494183951 (DEFAULT_TABLE table=test-table [id=d0657d7c637c4efc844b7e2a928ee17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:45.245119 17073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd177b76cf24af88947b59494183951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:45.245142 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd177b76cf24af88947b59494183951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:45.245235 17369 tablet_service.cc:1467] Processing CreateTablet for tablet 3bd177b76cf24af88947b59494183951 (DEFAULT_TABLE table=test-table [id=d0657d7c637c4efc844b7e2a928ee17d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:45.246333 17369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bd177b76cf24af88947b59494183951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:45.252453 17461 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Bootstrap starting.
I20260812 09:50:45.254211 17462 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Bootstrap starting.
I20260812 09:50:45.254374 17463 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Bootstrap starting.
I20260812 09:50:45.256139 17461 tablet_bootstrap.cc:654] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:45.256327 17462 tablet_bootstrap.cc:654] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:45.256435 17463 tablet_bootstrap.cc:654] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:45.257073 17462 log.cc:824] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:45.257095 17461 log.cc:824] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:45.257155 17463 log.cc:824] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:45.259241 17463 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: No bootstrap required, opened a new log
I20260812 09:50:45.259243 17462 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: No bootstrap required, opened a new log
I20260812 09:50:45.259454 17462 ts_tablet_manager.cc:1397] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260812 09:50:45.259454 17463 ts_tablet_manager.cc:1397] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 09:50:45.259653 17461 tablet_bootstrap.cc:492] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: No bootstrap required, opened a new log
I20260812 09:50:45.259840 17461 ts_tablet_manager.cc:1397] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260812 09:50:45.263041 17463 raft_consensus.cc:348] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.263320 17463 raft_consensus.cc:374] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:45.263381 17463 raft_consensus.cc:729] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a63145fafd41dab53bdd6eab052f3e, State: Initialized, Role: FOLLOWER
I20260812 09:50:45.263911 17463 consensus_queue.cc:260] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.264288 17461 raft_consensus.cc:348] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.264334 17462 raft_consensus.cc:348] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.264559 17462 raft_consensus.cc:374] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:45.264559 17461 raft_consensus.cc:374] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:45.264622 17462 raft_consensus.cc:729] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54110757c604937b643e2e4bbcea365, State: Initialized, Role: FOLLOWER
I20260812 09:50:45.264622 17461 raft_consensus.cc:729] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d1626a176849bea416ce187a19065d, State: Initialized, Role: FOLLOWER
I20260812 09:50:45.264760 17442 heartbeater.cc:503] Master 127.11.118.190:41873 was elected leader, sending a full tablet report...
I20260812 09:50:45.265158 17463 ts_tablet_manager.cc:1428] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:45.265103 17462 consensus_queue.cc:260] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.265103 17461 consensus_queue.cc:260] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.266089 17461 ts_tablet_manager.cc:1428] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:45.266430 17299 heartbeater.cc:503] Master 127.11.118.190:41873 was elected leader, sending a full tablet report...
I20260812 09:50:45.267151 17149 heartbeater.cc:503] Master 127.11.118.190:41873 was elected leader, sending a full tablet report...
I20260812 09:50:45.267387 17462 ts_tablet_manager.cc:1428] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260812 09:50:45.306257 17150 tablet.cc:2369] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:45.448886 17444 tablet.cc:2369] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:45.479063 17469 raft_consensus.cc:482] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:45.479354 17469 raft_consensus.cc:504] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.480650 17469 leader_election.cc:288] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b54110757c604937b643e2e4bbcea365 (127.11.118.130:39357), b3a63145fafd41dab53bdd6eab052f3e (127.11.118.131:40839)
I20260812 09:50:45.483310 17459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.481158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:37181 (local address 127.11.118.130:39357)
0812 09:50:45.481430 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.481475 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.481524 (+ 49us) server_negotiation.cc:407] Connection header received
0812 09:50:45.481708 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.481712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.481754 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.481817 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.482734 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.482739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.482742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.482758 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.482784 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.482799 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.483002 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.483072 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.483120 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260812 09:50:45.483466 17471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.481093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39357 (local address 127.11.118.129:37181)
0812 09:50:45.481439 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.481458 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.481564 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.481945 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.481947 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.481962 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.482534 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.482537 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.482551 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.482585 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.482974 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.482978 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.482983 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.483171 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.483267 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":154,"threads_started":1}
I20260812 09:50:45.483601 17460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.481735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:43117 (local address 127.11.118.131:40839)
0812 09:50:45.481877 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.481881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.482048 (+ 167us) server_negotiation.cc:407] Connection header received
0812 09:50:45.482173 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.482176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.482216 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.482313 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.483095 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.483099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.483101 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.483112 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.483133 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.483143 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.483236 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.483406 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.483447 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:45.483628 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.481563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40839 (local address 127.11.118.129:43117)
0812 09:50:45.481934 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.481948 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.482083 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.482331 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.482334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.482348 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:45.482837 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:50:45.482839 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:45.482909 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:50:45.482941 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:45.483267 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:45.483271 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:45.483274 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 09:50:45.483402 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 09:50:45.483436 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":77,"threads_started":1}
I20260812 09:50:45.484431 17393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd177b76cf24af88947b59494183951" candidate_uuid: "67d1626a176849bea416ce187a19065d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a63145fafd41dab53bdd6eab052f3e" is_pre_election: true
I20260812 09:50:45.484772 17393 raft_consensus.cc:2454] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d1626a176849bea416ce187a19065d in term 0.
I20260812 09:50:45.485263 17249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd177b76cf24af88947b59494183951" candidate_uuid: "67d1626a176849bea416ce187a19065d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54110757c604937b643e2e4bbcea365" is_pre_election: true
I20260812 09:50:45.485476 17024 leader_election.cc:302] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d1626a176849bea416ce187a19065d, b3a63145fafd41dab53bdd6eab052f3e; no voters:
I20260812 09:50:45.485540 17249 raft_consensus.cc:2454] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d1626a176849bea416ce187a19065d in term 0.
I20260812 09:50:45.485805 17469 raft_consensus.cc:2781] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:45.485937 17469 raft_consensus.cc:482] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:45.485999 17469 raft_consensus.cc:3037] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:45.487236 17469 raft_consensus.cc:504] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.487646 17469 leader_election.cc:288] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [CANDIDATE]: Term 1 election: Requested vote from peers b54110757c604937b643e2e4bbcea365 (127.11.118.130:39357), b3a63145fafd41dab53bdd6eab052f3e (127.11.118.131:40839)
I20260812 09:50:45.488312 17393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd177b76cf24af88947b59494183951" candidate_uuid: "67d1626a176849bea416ce187a19065d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3a63145fafd41dab53bdd6eab052f3e"
I20260812 09:50:45.488410 17249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bd177b76cf24af88947b59494183951" candidate_uuid: "67d1626a176849bea416ce187a19065d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b54110757c604937b643e2e4bbcea365"
I20260812 09:50:45.488521 17393 raft_consensus.cc:3037] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:45.488627 17249 raft_consensus.cc:3037] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:45.489943 17249 raft_consensus.cc:2454] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d1626a176849bea416ce187a19065d in term 1.
I20260812 09:50:45.490079 17393 raft_consensus.cc:2454] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d1626a176849bea416ce187a19065d in term 1.
I20260812 09:50:45.490320 17024 leader_election.cc:302] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d1626a176849bea416ce187a19065d, b54110757c604937b643e2e4bbcea365; no voters:
I20260812 09:50:45.490522 17469 raft_consensus.cc:2781] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:45.490777 17469 raft_consensus.cc:686] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [term 1 LEADER]: Becoming Leader. State: Replica: 67d1626a176849bea416ce187a19065d, State: Running, Role: LEADER
I20260812 09:50:45.491158 17469 consensus_queue.cc:237] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } }
I20260812 09:50:45.494886 16941 catalog_manager.cc:5495] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d reported cstate change: term changed from 0 to 1, leader changed from <none> to 67d1626a176849bea416ce187a19065d (127.11.118.129). New cstate: current_term: 1 leader_uuid: "67d1626a176849bea416ce187a19065d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d1626a176849bea416ce187a19065d" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 } health_report { overall_health: UNKNOWN } } }
W20260812 09:50:45.501248 17300 tablet.cc:2369] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:45.536599 17457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.534845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46582 (local address 127.11.118.129:38739)
0812 09:50:45.535055 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.535059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.535095 (+ 36us) server_negotiation.cc:407] Connection header received
0812 09:50:45.535182 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.535185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.535245 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.535316 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.536110 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.536114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.536117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.536129 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.536151 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.536162 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.536282 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.536433 (+ 151us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.536478 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260812 09:50:45.543520 17393 raft_consensus.cc:1261] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 1 FOLLOWER]: Refusing update from remote peer 67d1626a176849bea416ce187a19065d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:45.543521 17249 raft_consensus.cc:1261] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 1 FOLLOWER]: Refusing update from remote peer 67d1626a176849bea416ce187a19065d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:45.544337 17469 consensus_queue.cc:1035] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3a63145fafd41dab53bdd6eab052f3e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:45.544872 17473 consensus_queue.cc:1035] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b54110757c604937b643e2e4bbcea365" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:45.564513 16940 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:45.564720 16940 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:45.567669 16940 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9476bc17f7034430bfa5ad38266c95e9: Sending DeleteTablet for 3 replicas of tablet 3bd177b76cf24af88947b59494183951
I20260812 09:50:45.568598 17073 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd177b76cf24af88947b59494183951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:45 UTC) from {username='slave'} at 127.0.0.1:46578
I20260812 09:50:45.568744 17227 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd177b76cf24af88947b59494183951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:45 UTC) from {username='slave'} at 127.0.0.1:50586
I20260812 09:50:45.568816 17369 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bd177b76cf24af88947b59494183951 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:45 UTC) from {username='slave'} at 127.0.0.1:56992
I20260812 09:50:45.569414 17487 tablet_replica.cc:330] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: stopping tablet replica
I20260812 09:50:45.569741 17486 tablet_replica.cc:330] T 3bd177b76cf24af88947b59494183951 P 67d1626a176849bea416ce187a19065d: stopping tablet replica
I20260812 09:50:45.569836 17487 raft_consensus.cc:2229] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:45.570037 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17008
I20260812 09:50:45.576743 17487 raft_consensus.cc:2258] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:45.576797 17489 tablet_replica.cc:330] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: stopping tablet replica
I20260812 09:50:45.577222 17489 raft_consensus.cc:2229] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:45.577658 17489 raft_consensus.cc:2258] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:45.579465 17487 ts_tablet_manager.cc:1905] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:45.579532 17489 ts_tablet_manager.cc:1905] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:45.582099 17487 ts_tablet_manager.cc:1918] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:45.582235 17487 log.cc:1196] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/3bd177b76cf24af88947b59494183951
I20260812 09:50:45.582552 17487 ts_tablet_manager.cc:1939] T 3bd177b76cf24af88947b59494183951 P b3a63145fafd41dab53bdd6eab052f3e: Deleting consensus metadata
I20260812 09:50:45.583333 17489 ts_tablet_manager.cc:1918] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:45.583452 17489 log.cc:1196] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/3bd177b76cf24af88947b59494183951
I20260812 09:50:45.583822 17489 ts_tablet_manager.cc:1939] T 3bd177b76cf24af88947b59494183951 P b54110757c604937b643e2e4bbcea365: Deleting consensus metadata
I20260812 09:50:45.584046 16923 catalog_manager.cc:4841] TS b3a63145fafd41dab53bdd6eab052f3e (127.11.118.131:40839): tablet 3bd177b76cf24af88947b59494183951 (table test-table [id=d0657d7c637c4efc844b7e2a928ee17d]) successfully deleted
I20260812 09:50:45.585075 16923 catalog_manager.cc:4841] TS b54110757c604937b643e2e4bbcea365 (127.11.118.130:39357): tablet 3bd177b76cf24af88947b59494183951 (table test-table [id=d0657d7c637c4efc844b7e2a928ee17d]) successfully deleted
W20260812 09:50:45.585669 16926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:38739 (error 108)
I20260812 09:50:45.585753 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17152
I20260812 09:50:45.590265 17456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.589924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38739 (local address 127.0.0.1:46592)
0812 09:50:45.590093 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.590181 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260812 09:50:45.590467 16926 catalog_manager.cc:4584] TS 67d1626a176849bea416ce187a19065d (127.11.118.129:38739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3bd177b76cf24af88947b59494183951: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38739: connect: Connection refused (error 111)
I20260812 09:50:45.595355 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17302
I20260812 09:50:45.606865 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 16905
2026-08-12T09:50:45Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1287 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 09:50:45.636863 11738 mini_oidc.cc:152] Starting JWKS server
I20260812 09:50:45.638933 11738 webserver.cc:460] Webserver started at https://127.0.0.1:35991/ using document root <none> and password file <none>
I20260812 09:50:45.639214 11738 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 09:50:45.639545 11738 webserver.cc:460] Webserver started at http://127.0.0.1:36379/ using document root <none> and password file <none>
2026-08-12T09:50:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:45Z Disabled control of system clock
I20260812 09:50:45.652242 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38805
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:43965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38805
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35991/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/testchainca.cert with env {}
W20260812 09:50:45.778580 17499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:45.778901 17499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:45.778944 17499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:45.783167 17499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:45.783250 17499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:45.783267 17499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:45.783283 17499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:45.783300 17499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 09:50:45.783317 17499 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 09:50:45.783330 17499 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35991/jwks.json
I20260812 09:50:45.789690 17499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38805
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35991/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:45.791105 17499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:45.792451 17499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:45.801942 17509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:45.801951 17505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:45.802017 17499 server_base.cc:1034] running on GCE node
W20260812 09:50:45.801942 17507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:45.803135 17499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:45.804287 17499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:45.805502 17499 hybrid_clock.cc:648] HybridClock initialized: now 1786528245805485 us; error 30 us; skew 500 ppm
I20260812 09:50:45.807732 17499 webserver.cc:460] Webserver started at http://127.11.118.190:46465/ using document root <none> and password file <none>
I20260812 09:50:45.808391 17499 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:45.808497 17499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:45.808743 17499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:45.811064 17499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "839f04bbfe9c4499b967d92a088600d1"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "346907d464d2b8c088ce45317084a1e4"
server_key_iv: "db68945d06fb53ba66c7840aa3e453c9"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.811707 17499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "839f04bbfe9c4499b967d92a088600d1"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "346907d464d2b8c088ce45317084a1e4"
server_key_iv: "db68945d06fb53ba66c7840aa3e453c9"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.816073 17499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:50:45.818933 17516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:45.820514 17499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:45.820698 17499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "839f04bbfe9c4499b967d92a088600d1"
format_stamp: "Formatted at 2026-08-12 09:50:45 on dist-test-slave-2w3w"
server_key: "346907d464d2b8c088ce45317084a1e4"
server_key_iv: "db68945d06fb53ba66c7840aa3e453c9"
server_key_version: "encryptionkey@0"
I20260812 09:50:45.820843 17499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:45.869613 17499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:45.870507 17499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:45.870726 17499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:45.878826 17499 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:38805
I20260812 09:50:45.878845 17575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:38805 every 8 connection(s)
I20260812 09:50:45.879925 17499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:45.880714 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17499
I20260812 09:50:45.880875 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:45.881197 11738 external_mini_cluster.cc:1428] Setting key 1e432dfe4ef892eaa2e46f1b5aae8bce
I20260812 09:50:45.884208 17576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:45.890254 17576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1: Bootstrap starting.
I20260812 09:50:45.891412 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.882860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52820 (local address 127.11.118.190:38805)
0812 09:50:45.883623 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.883639 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.883676 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:50:45.884443 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.884464 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.884868 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.885240 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:45.885690 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:45.886720 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:45.887727 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:45.888222 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:45.888407 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:45.889462 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:45.889467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:45.889479 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:45.889884 (+ 405us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:45.889942 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:45.889965 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:45.890097 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:45.890255 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 09:50:45.890563 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":163,"threads_started":1}
I20260812 09:50:45.892911 17576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:45.893826 17576 log.cc:824] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:45.894797 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:50:45.896744 17576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1: No bootstrap required, opened a new log
I20260812 09:50:45.900755 17576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } }
I20260812 09:50:45.901036 17576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:45.901073 17576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 839f04bbfe9c4499b967d92a088600d1, State: Initialized, Role: FOLLOWER
I20260812 09:50:45.901571 17576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } }
I20260812 09:50:45.901705 17576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:45.901803 17576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:45.901935 17576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:45.903054 17576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } }
I20260812 09:50:45.903442 17576 leader_election.cc:302] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 839f04bbfe9c4499b967d92a088600d1; no voters:
I20260812 09:50:45.903836 17576 leader_election.cc:288] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:45.903928 17582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:45.904167 17582 raft_consensus.cc:686] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [term 1 LEADER]: Becoming Leader. State: Replica: 839f04bbfe9c4499b967d92a088600d1, State: Running, Role: LEADER
I20260812 09:50:45.904493 17582 consensus_queue.cc:237] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } }
I20260812 09:50:45.905318 17576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:45.906275 17583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "839f04bbfe9c4499b967d92a088600d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } } }
I20260812 09:50:45.906333 17584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 839f04bbfe9c4499b967d92a088600d1. Latest consensus state: current_term: 1 leader_uuid: "839f04bbfe9c4499b967d92a088600d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "839f04bbfe9c4499b967d92a088600d1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38805 } } }
I20260812 09:50:45.906425 17583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:45.906472 17584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:45.906875 17591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:45.910295 17591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:45.917739 17591 catalog_manager.cc:1347] Generated new cluster ID: 84f0d3193f644f2097f0b21d5b1361b7
I20260812 09:50:45.917920 17591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:45.964483 17591 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:45.965534 17591 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:45.977505 17591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 839f04bbfe9c4499b967d92a088600d1: Generated new TSK 0
I20260812 09:50:45.978462 17591 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 09:50:46.022925 17609 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 09:50:46.023221 17609 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 09:50:46.023824 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:45.999070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52832 (local address 127.11.118.190:38805)
0812 09:50:45.999217 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:45.999222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:45.999428 (+ 206us) server_negotiation.cc:407] Connection header received
0812 09:50:45.999707 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:45.999710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:45.999765 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:45.999919 (+ 154us) server_negotiation.cc:226] Negotiated authn=JWT
0812 09:50:46.000312 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.000883 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.002210 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.002438 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.002536 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.003170 (+ 634us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 09:50:46.023417 (+ 20247us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 09:50:46.023701 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52832: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 09:50:46.023926 17579 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52832: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 09:50:46.025656 17608 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:45.998875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38805 (local address 127.0.0.1:52832)
0812 09:50:45.999317 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:45.999334 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:45.999489 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:45.999958 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:45.999961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:45.999970 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0812 09:50:46.000097 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.000103 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.001051 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.001055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.002024 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.002036 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.002587 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.002591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.002688 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.002759 (+ 71us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 09:50:46.023717 (+ 20958us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 09:50:46.024074 (+ 357us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.118.190:38805: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":186,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.118.190:38805: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35991/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 09:50:46.026548 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17499
2026-08-12T09:50:46Z chronyd exiting
I20260812 09:50:46.067243 11738 test_util.cc:175] -----------------------------------------------
I20260812 09:50:46.067399 11738 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786528216186196-11738-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (433 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 09:50:46.068614 11738 mini_oidc.cc:152] Starting JWKS server
I20260812 09:50:46.069533 11738 webserver.cc:460] Webserver started at https://127.0.0.1:34369/ using document root <none> and password file <none>
I20260812 09:50:46.069676 11738 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 09:50:46.069969 11738 webserver.cc:460] Webserver started at http://127.0.0.1:33491/ using document root <none> and password file <none>
2026-08-12T09:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:46Z Disabled control of system clock
I20260812 09:50:46.081401 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33285
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:33285
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34369/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/testchainca.cert with env {}
W20260812 09:50:46.203631 17615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:46.203974 17615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:46.204020 17615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:46.208537 17615 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:46.208616 17615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:46.208631 17615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:46.208649 17615 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:46.208665 17615 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 09:50:46.208729 17615 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 09:50:46.208757 17615 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34369/jwks.json
I20260812 09:50:46.214766 17615 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:33285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34369/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:46.216037 17615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:46.217068 17615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:46.226261 17621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:46.226261 17623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:46.226293 17620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:46.226706 17615 server_base.cc:1034] running on GCE node
I20260812 09:50:46.227499 17615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:46.228948 17615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:46.230217 17615 hybrid_clock.cc:648] HybridClock initialized: now 1786528246230203 us; error 50 us; skew 500 ppm
I20260812 09:50:46.232702 17615 webserver.cc:460] Webserver started at http://127.11.118.190:35501/ using document root <none> and password file <none>
I20260812 09:50:46.233376 17615 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:46.233500 17615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:46.233757 17615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:46.236199 17615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "ebca6c92afe444cfb7329ee0465ba182"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "e1531fd0db4ae27d797166943815f181"
server_key_iv: "5f1190aedbe054154cc4360942415dc3"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.236845 17615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "ebca6c92afe444cfb7329ee0465ba182"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "e1531fd0db4ae27d797166943815f181"
server_key_iv: "5f1190aedbe054154cc4360942415dc3"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.241379 17615 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 09:50:46.244113 17629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:46.245496 17615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:46.245664 17615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "ebca6c92afe444cfb7329ee0465ba182"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "e1531fd0db4ae27d797166943815f181"
server_key_iv: "5f1190aedbe054154cc4360942415dc3"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.245810 17615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:46.255930 17615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:46.256704 17615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:46.256932 17615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:46.264854 17615 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:33285
I20260812 09:50:46.264943 17689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:33285 every 8 connection(s)
I20260812 09:50:46.265965 17615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:46.268994 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17615
I20260812 09:50:46.269156 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:46.269510 11738 external_mini_cluster.cc:1428] Setting key cb7935faf160c857535b4cbe123fdbab
I20260812 09:50:46.269554 17690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:46.276832 17690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182: Bootstrap starting.
I20260812 09:50:46.279543 17690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:46.280179 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:46.271043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59518 (local address 127.11.118.190:33285)
0812 09:50:46.271771 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:46.271795 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:46.271837 (+ 42us) server_negotiation.cc:407] Connection header received
0812 09:50:46.272785 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:46.272809 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:46.273302 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:46.273737 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:46.274206 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.275328 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.276299 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.276826 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.277021 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.278124 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:46.278130 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:46.278143 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:46.278601 (+ 458us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:46.278669 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:46.278691 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:46.278823 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:46.279018 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 09:50:46.279296 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":169,"threads_started":1}
I20260812 09:50:46.280427 17690 log.cc:824] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:46.282851 17690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182: No bootstrap required, opened a new log
I20260812 09:50:46.283452 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:50:46.287026 17690 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } }
I20260812 09:50:46.287318 17690 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:46.287405 17690 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebca6c92afe444cfb7329ee0465ba182, State: Initialized, Role: FOLLOWER
I20260812 09:50:46.287904 17690 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } }
I20260812 09:50:46.288143 17690 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:46.288304 17690 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:46.288462 17690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:46.289669 17690 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } }
I20260812 09:50:46.290081 17690 leader_election.cc:302] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebca6c92afe444cfb7329ee0465ba182; no voters:
I20260812 09:50:46.290493 17690 leader_election.cc:288] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:46.290597 17696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:46.290856 17696 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [term 1 LEADER]: Becoming Leader. State: Replica: ebca6c92afe444cfb7329ee0465ba182, State: Running, Role: LEADER
I20260812 09:50:46.291208 17696 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } }
I20260812 09:50:46.291919 17690 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:46.293001 17697 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebca6c92afe444cfb7329ee0465ba182" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } } }
I20260812 09:50:46.293152 17697 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:46.293418 17698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebca6c92afe444cfb7329ee0465ba182. Latest consensus state: current_term: 1 leader_uuid: "ebca6c92afe444cfb7329ee0465ba182" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebca6c92afe444cfb7329ee0465ba182" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33285 } } }
I20260812 09:50:46.293591 17705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:46.293591 17698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:46.297888 17705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:46.305477 17705 catalog_manager.cc:1347] Generated new cluster ID: 39aa4e36218a408b92fcc13a24b36f34
I20260812 09:50:46.305604 17705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:46.312317 17705 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:46.313750 17705 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:46.332912 17705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebca6c92afe444cfb7329ee0465ba182: Generated new TSK 0
I20260812 09:50:46.333762 17705 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 09:50:46.366241 17722 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 09:50:46.366348 17722 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 09:50:46.367147 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:46.348304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59530 (local address 127.11.118.190:33285)
0812 09:50:46.348474 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:46.348479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:46.348750 (+ 271us) server_negotiation.cc:407] Connection header received
0812 09:50:46.348846 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:46.348849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:46.348902 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:46.349006 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0812 09:50:46.349280 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.349916 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.351418 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.351638 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.351730 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.352100 (+ 370us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 09:50:46.366682 (+ 14582us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 09:50:46.366937 (+ 255us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59530: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 09:50:46.367249 17693 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59530: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 09:50:46.367368 17721 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:46.348195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:33285 (local address 127.0.0.1:59530)
0812 09:50:46.348576 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:46.348593 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:46.348723 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:46.349033 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:46.349036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:46.349044 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0812 09:50:46.349161 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.349167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.350077 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.350082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.351182 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.351193 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.351772 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.351776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.351867 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.351899 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 09:50:46.366934 (+ 15035us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 09:50:46.367175 (+ 241us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.118.190:33285: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34369/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":132,"threads_started":1}
I20260812 09:50:46.368016 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17615
2026-08-12T09:50:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (342 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 09:50:46.411161 11738 mini_oidc.cc:152] Starting JWKS server
I20260812 09:50:46.412075 11738 webserver.cc:460] Webserver started at https://127.0.0.1:35641/ using document root <none> and password file <none>
I20260812 09:50:46.412199 11738 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 09:50:46.412490 11738 webserver.cc:460] Webserver started at http://127.0.0.1:41213/ using document root <none> and password file <none>
2026-08-12T09:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:46Z Disabled control of system clock
I20260812 09:50:46.424172 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45371
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:34927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45371
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35641/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 09:50:46.540249 17728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:46.540547 17728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:46.540591 17728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:46.544646 17728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:46.544713 17728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:46.544727 17728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:46.544744 17728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:46.544766 17728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 09:50:46.544782 17728 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 09:50:46.544821 17728 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35641/jwks.json
I20260812 09:50:46.549808 17728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35641/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:46.551141 17728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:46.552554 17728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:46.561717 17735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:46.561748 17734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:46.561866 17728 server_base.cc:1034] running on GCE node
W20260812 09:50:46.561748 17737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:46.562652 17728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:46.563961 17728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:46.565155 17728 hybrid_clock.cc:648] HybridClock initialized: now 1786528246565139 us; error 33 us; skew 500 ppm
I20260812 09:50:46.567582 17728 webserver.cc:460] Webserver started at http://127.11.118.190:43873/ using document root <none> and password file <none>
I20260812 09:50:46.568374 17728 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:46.568555 17728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:46.568958 17728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:46.571501 17728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "c762763036d44c0cb2ae9ed45d444dba"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "fac68e4e6edc3167b8b33730b3b9e3f6"
server_key_iv: "61d97fcb1ea3f7d03ceded75266cbdc4"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.572155 17728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "c762763036d44c0cb2ae9ed45d444dba"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "fac68e4e6edc3167b8b33730b3b9e3f6"
server_key_iv: "61d97fcb1ea3f7d03ceded75266cbdc4"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.576675 17728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:46.579600 17743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:46.581260 17728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:46.581467 17728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "c762763036d44c0cb2ae9ed45d444dba"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "fac68e4e6edc3167b8b33730b3b9e3f6"
server_key_iv: "61d97fcb1ea3f7d03ceded75266cbdc4"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.581626 17728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:46.601589 17728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:46.602458 17728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:46.602725 17728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:46.610563 17728 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:45371
I20260812 09:50:46.610567 17802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:45371 every 8 connection(s)
I20260812 09:50:46.611689 17728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:46.615080 17803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:46.621151 17803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: Bootstrap starting.
I20260812 09:50:46.621899 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17728
I20260812 09:50:46.622042 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:46.622309 11738 external_mini_cluster.cc:1428] Setting key d0eca46444f61b4d92991d1a9993c9dc
I20260812 09:50:46.624403 17803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:46.625253 17803 log.cc:824] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:46.627866 17803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: No bootstrap required, opened a new log
I20260812 09:50:46.632663 17803 raft_consensus.cc:348] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } }
I20260812 09:50:46.632947 17803 raft_consensus.cc:374] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:46.633011 17803 raft_consensus.cc:729] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c762763036d44c0cb2ae9ed45d444dba, State: Initialized, Role: FOLLOWER
I20260812 09:50:46.633458 17803 consensus_queue.cc:260] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } }
I20260812 09:50:46.633503 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:46.623793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48464 (local address 127.11.118.190:45371)
0812 09:50:46.624576 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:46.624593 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:46.624634 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:50:46.625360 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:46.625387 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:46.625925 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:46.626307 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:46.626799 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.628032 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.629293 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.629852 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.630002 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.631072 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:46.631079 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:46.631094 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:46.631563 (+ 469us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:46.631630 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:46.631653 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:46.631743 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:46.631975 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 09:50:46.632398 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":163,"threads_started":1}
I20260812 09:50:46.633639 17803 raft_consensus.cc:388] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:46.633705 17803 raft_consensus.cc:482] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:46.633807 17803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:46.634876 17803 raft_consensus.cc:504] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } }
I20260812 09:50:46.635299 17803 leader_election.cc:302] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c762763036d44c0cb2ae9ed45d444dba; no voters:
I20260812 09:50:46.635689 17803 leader_election.cc:288] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:46.635850 17808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:46.636101 17808 raft_consensus.cc:686] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [term 1 LEADER]: Becoming Leader. State: Replica: c762763036d44c0cb2ae9ed45d444dba, State: Running, Role: LEADER
I20260812 09:50:46.636418 17808 consensus_queue.cc:237] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } }
I20260812 09:50:46.636698 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:50:46.637137 17803 sys_catalog.cc:564] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:46.638391 17810 sys_catalog.cc:455] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [sys.catalog]: SysCatalogTable state changed. Reason: New leader c762763036d44c0cb2ae9ed45d444dba. Latest consensus state: current_term: 1 leader_uuid: "c762763036d44c0cb2ae9ed45d444dba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } } }
I20260812 09:50:46.638531 17810 sys_catalog.cc:458] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:46.638824 17809 sys_catalog.cc:455] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c762763036d44c0cb2ae9ed45d444dba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c762763036d44c0cb2ae9ed45d444dba" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45371 } } }
I20260812 09:50:46.638923 17809 sys_catalog.cc:458] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba [sys.catalog]: This master's current role is: LEADER
W20260812 09:50:46.642611 17825 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:50:46.642735 17825 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:50:46.642872 17818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:46.643864 17818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:46.650131 17818 catalog_manager.cc:1347] Generated new cluster ID: f27566152d864734a12aefd45929c3c5
I20260812 09:50:46.650254 17818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:46.657447 17818 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:46.658627 17818 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:46.668146 17818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c762763036d44c0cb2ae9ed45d444dba: Generated new TSK 0
I20260812 09:50:46.669065 17818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:50:46.686147 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:46.680060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.11.118.190:45371)
0812 09:50:46.680205 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:46.680210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:46.680417 (+ 207us) server_negotiation.cc:407] Connection header received
0812 09:50:46.680630 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:46.680634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:46.680700 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:46.680839 (+ 139us) server_negotiation.cc:226] Negotiated authn=JWT
0812 09:50:46.681094 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.681959 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.682942 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.683342 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.683450 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.683837 (+ 387us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 09:50:46.685527 (+ 1690us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35641/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 09:50:46.685979 (+ 452us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48468: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35641/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 09:50:46.686535 17806 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48468: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35641/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 09:50:46.688218 17834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:46.679985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45371 (local address 127.0.0.1:48468)
0812 09:50:46.680317 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:46.680332 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:46.680466 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:46.680853 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:46.680856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:46.680863 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0812 09:50:46.680980 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.680985 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.682106 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.682109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.682804 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:46.682813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.683506 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.683509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:46.683584 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.683611 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 09:50:46.685726 (+ 2115us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35641/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 09:50:46.688021 (+ 2295us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.118.190:45371: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35641/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":2034,"thread_start_us":147,"threads_started":1}
I20260812 09:50:46.688660 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17728
E20260812 09:50:46.701642 17835 webserver.cc:533] Webserver: sslize failed:
E20260812 09:50:46.701740 17835 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T09:50:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (322 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T09:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:46Z Disabled control of system clock
I20260812 09:50:46.745838 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:32961
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:39727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:32961
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/testchainca.cert with env {}
W20260812 09:50:46.873373 17839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:46.873701 17839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:46.873792 17839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:46.878134 17839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:46.878223 17839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:46.878239 17839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:46.878257 17839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:46.878273 17839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 09:50:46.878290 17839 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 09:50:46.878304 17839 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 09:50:46.884403 17839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:32961
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:32961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:46.885578 17839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:46.886598 17839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:46.895738 17846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:46.895761 17845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:46.895762 17848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:46.896708 17839 server_base.cc:1034] running on GCE node
I20260812 09:50:46.897456 17839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:46.898693 17839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:46.899928 17839 hybrid_clock.cc:648] HybridClock initialized: now 1786528246899913 us; error 71 us; skew 500 ppm
I20260812 09:50:46.902222 17839 webserver.cc:460] Webserver started at http://127.11.118.190:32871/ using document root <none> and password file <none>
I20260812 09:50:46.902892 17839 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:46.903020 17839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:46.903224 17839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:46.905474 17839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "475bffe4b6a0453c8b23e8d9f3a9d836"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "52998927d8a57adc8457f90caa59cba7"
server_key_iv: "d0a75b3c2892498d65cd63829585241a"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.906054 17839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "475bffe4b6a0453c8b23e8d9f3a9d836"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "52998927d8a57adc8457f90caa59cba7"
server_key_iv: "d0a75b3c2892498d65cd63829585241a"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.910346 17839 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260812 09:50:46.913120 17854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:46.914664 17839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:46.914811 17839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "475bffe4b6a0453c8b23e8d9f3a9d836"
format_stamp: "Formatted at 2026-08-12 09:50:46 on dist-test-slave-2w3w"
server_key: "52998927d8a57adc8457f90caa59cba7"
server_key_iv: "d0a75b3c2892498d65cd63829585241a"
server_key_version: "encryptionkey@0"
I20260812 09:50:46.914925 17839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:46.935459 17839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:46.936203 17839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:46.936437 17839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:46.944636 17839 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:32961
I20260812 09:50:46.944648 17908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:32961 every 8 connection(s)
I20260812 09:50:46.945724 17839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:46.948902 17909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:46.954015 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17839
I20260812 09:50:46.954147 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:46.954450 11738 external_mini_cluster.cc:1428] Setting key 78b3a30df28f50f6ae7dd3268073e18d
I20260812 09:50:46.955070 17909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836: Bootstrap starting.
I20260812 09:50:46.957901 17909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:46.958899 17909 log.cc:824] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:46.961367 17909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836: No bootstrap required, opened a new log
I20260812 09:50:46.966599 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:46.956071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59466 (local address 127.11.118.190:32961)
0812 09:50:46.956851 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:46.956870 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:46.956915 (+ 45us) server_negotiation.cc:407] Connection header received
0812 09:50:46.957819 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:46.957847 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:46.958458 (+ 611us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:46.958849 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:46.959384 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.960721 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.961899 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:46.962608 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:46.962824 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:46.964010 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:46.964017 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:46.964037 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:50:46.964659 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:46.964743 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:50:46.964771 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:46.964892 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:46.965082 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 09:50:46.965485 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":138,"threads_started":1}
I20260812 09:50:46.966559 17909 raft_consensus.cc:348] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } }
I20260812 09:50:46.966890 17909 raft_consensus.cc:374] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:46.966954 17909 raft_consensus.cc:729] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475bffe4b6a0453c8b23e8d9f3a9d836, State: Initialized, Role: FOLLOWER
I20260812 09:50:46.967453 17909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } }
I20260812 09:50:46.967572 17909 raft_consensus.cc:388] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:46.967612 17909 raft_consensus.cc:482] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:46.967679 17909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:46.968834 17909 raft_consensus.cc:504] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } }
I20260812 09:50:46.969213 17909 leader_election.cc:302] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 475bffe4b6a0453c8b23e8d9f3a9d836; no voters:
I20260812 09:50:46.969552 17909 leader_election.cc:288] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:46.969759 17914 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:46.969815 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:50:46.970036 17914 raft_consensus.cc:686] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [term 1 LEADER]: Becoming Leader. State: Replica: 475bffe4b6a0453c8b23e8d9f3a9d836, State: Running, Role: LEADER
I20260812 09:50:46.970345 17914 consensus_queue.cc:237] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } }
I20260812 09:50:46.971107 17909 sys_catalog.cc:564] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:46.972041 17916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } } }
I20260812 09:50:46.972191 17916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:46.972602 17917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 475bffe4b6a0453c8b23e8d9f3a9d836. Latest consensus state: current_term: 1 leader_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475bffe4b6a0453c8b23e8d9f3a9d836" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 32961 } } }
I20260812 09:50:46.972671 17925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:46.972715 17917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:46.976351 17925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:46.982739 17925 catalog_manager.cc:1347] Generated new cluster ID: 031955a8b9eb4f538f2975b2be4cb829
I20260812 09:50:46.982839 17925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:47.003935 17925 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:47.005259 17925 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:47.019712 17925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 475bffe4b6a0453c8b23e8d9f3a9d836: Generated new TSK 0
I20260812 09:50:47.020668 17925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:50:47.071092 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:47.037632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59474 (local address 127.11.118.190:32961)
0812 09:50:47.037770 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:47.037774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:47.037991 (+ 217us) server_negotiation.cc:407] Connection header received
0812 09:50:47.038085 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:47.038088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:47.038142 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:47.038246 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0812 09:50:47.038529 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:47.039193 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:47.040462 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:47.040693 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:47.040780 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:47.041152 (+ 372us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 09:50:47.070547 (+ 29395us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 09:50:47.070831 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59474: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 09:50:47.071223 17912 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59474: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 09:50:47.071329 17942 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:47.037414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:32961 (local address 127.0.0.1:59474)
0812 09:50:47.037823 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:47.037839 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:47.037967 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:47.038278 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:47.038281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:47.038291 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0812 09:50:47.038411 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:47.038417 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:47.039309 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:47.039314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:47.040321 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:47.040333 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:47.040832 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:47.040836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:47.040937 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:47.040970 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 09:50:47.070834 (+ 29864us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 09:50:47.071082 (+ 248us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.118.190:32961: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":148,"threads_started":1}
I20260812 09:50:47.072171 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17839
2026-08-12T09:50:47Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (360 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (130 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (132 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:47 dist-test-slave-2w3w krb5kdc[17956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:47 dist-test-slave-2w3w krb5kdc[17956](info): set up 2 sockets
Aug 12 09:50:47 dist-test-slave-2w3w krb5kdc[17956](info): commencing operation
krb5kdc: starting...
W20260812 09:50:48.491168 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:48 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:50:48.642831 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36307
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:48.764739 17969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:48.765086 17969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:48.765174 17969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:48.769392 17969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:48.769498 17969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:48.769537 17969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:48.769598 17969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:48.769636 17969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:48.775257 17969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:36307
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:48.776396 17969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:48.777477 17969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:48.786420 17975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:48.786600 17969 server_base.cc:1034] running on GCE node
W20260812 09:50:48.786830 17976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:48.786882 17978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:48.787631 17969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:48.788808 17969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:48.789999 17969 hybrid_clock.cc:648] HybridClock initialized: now 1786528248789965 us; error 51 us; skew 500 ppm
Aug 12 09:50:48 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528248, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:48.799137 17969 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:50:48.800267 17969 webserver.cc:460] Webserver started at http://127.11.118.190:34581/ using document root <none> and password file <none>
I20260812 09:50:48.800904 17969 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:48.800974 17969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:48.801158 17969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:48.803454 17969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "eb21c936da0842e6a6ba14d9a696330f"
format_stamp: "Formatted at 2026-08-12 09:50:48 on dist-test-slave-2w3w"
server_key: "aefaa7d43e500b457f85777110ca8d51"
server_key_iv: "d206da5ae47508657752c3b97791f6d8"
server_key_version: "encryptionkey@0"
I20260812 09:50:48.804020 17969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "eb21c936da0842e6a6ba14d9a696330f"
format_stamp: "Formatted at 2026-08-12 09:50:48 on dist-test-slave-2w3w"
server_key: "aefaa7d43e500b457f85777110ca8d51"
server_key_iv: "d206da5ae47508657752c3b97791f6d8"
server_key_version: "encryptionkey@0"
I20260812 09:50:48.808090 17969 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:48.810751 17985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:48.812227 17969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:48.812361 17969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "eb21c936da0842e6a6ba14d9a696330f"
format_stamp: "Formatted at 2026-08-12 09:50:48 on dist-test-slave-2w3w"
server_key: "aefaa7d43e500b457f85777110ca8d51"
server_key_iv: "d206da5ae47508657752c3b97791f6d8"
server_key_version: "encryptionkey@0"
I20260812 09:50:48.812525 17969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:48.835085 17969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:48.838815 17969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:48.839111 17969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:48.847846 17969 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:36307
I20260812 09:50:48.847882 18041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:36307 every 8 connection(s)
I20260812 09:50:48.848898 17969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:48.851820 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 17969
I20260812 09:50:48.851953 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:48.852092 18042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:48.852363 11738 external_mini_cluster.cc:1428] Setting key 84d08dfe147a216f55af5d5b3ae0a77b
I20260812 09:50:48.860247 18042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f: Bootstrap starting.
I20260812 09:50:48.863233 18042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f: Neither blocks nor log segments found. Creating new log.
Aug 12 09:50:48 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:48.864144 18042 log.cc:824] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:48.867192 18042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f: No bootstrap required, opened a new log
I20260812 09:50:48.870793 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:48.853983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.11.118.190:36307)
0812 09:50:48.854481 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:48.854503 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:48.854549 (+ 46us) server_negotiation.cc:407] Connection header received
0812 09:50:48.855899 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:48.855927 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:48.856461 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:48.856865 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:48.857727 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:48.859338 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:48.860352 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:48.861079 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:48.861258 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:48.864619 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:48.864628 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:48.864655 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:48.864686 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:48.867004 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:48.867669 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:48.867676 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:48.867682 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:48.867841 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:48.868219 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:48.868224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:48.868228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:48.868787 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:48.868988 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:48.869293 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 09:50:48.869672 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":139,"threads_started":1}
I20260812 09:50:48.872459 18042 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } }
I20260812 09:50:48.872738 18042 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:48.872773 18042 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb21c936da0842e6a6ba14d9a696330f, State: Initialized, Role: FOLLOWER
I20260812 09:50:48.873287 18042 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } }
I20260812 09:50:48.873471 18042 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:48.873538 18042 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:48.873641 18042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:48.874657 18042 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } }
I20260812 09:50:48.875077 18042 leader_election.cc:302] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb21c936da0842e6a6ba14d9a696330f; no voters:
I20260812 09:50:48.875468 18042 leader_election.cc:288] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:48.875631 18048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:48.875864 18048 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [term 1 LEADER]: Becoming Leader. State: Replica: eb21c936da0842e6a6ba14d9a696330f, State: Running, Role: LEADER
I20260812 09:50:48.876210 18048 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } }
I20260812 09:50:48.876866 18042 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:48.877990 18050 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb21c936da0842e6a6ba14d9a696330f. Latest consensus state: current_term: 1 leader_uuid: "eb21c936da0842e6a6ba14d9a696330f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } } }
I20260812 09:50:48.878279 18050 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:48.878733 18049 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb21c936da0842e6a6ba14d9a696330f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb21c936da0842e6a6ba14d9a696330f" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36307 } } }
I20260812 09:50:48.879001 18049 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:48.879915 18058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:48.882719 18058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:48.889364 18058 catalog_manager.cc:1347] Generated new cluster ID: 7829b53f27734112aa67c5d384739213
I20260812 09:50:48.889493 18058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:48.903575 18058 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:48.904974 18058 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:48.912707 18058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb21c936da0842e6a6ba14d9a696330f: Generated new TSK 0
I20260812 09:50:48.913887 18058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:50:48.964609 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:49.126196 18071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:49.126526 18071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:49.126576 18071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:49.130847 18071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:49.130940 18071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:49.131026 18071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:49.137603 18071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:49.138827 18071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:49.139917 18071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:49.151410 18078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.151464 18081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.151410 18079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:49.151787 18071 server_base.cc:1034] running on GCE node
I20260812 09:50:49.152361 18071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:49.153126 18071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:49.154364 18071 hybrid_clock.cc:648] HybridClock initialized: now 1786528249154350 us; error 32 us; skew 500 ppm
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.157783 18071 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:50:49.158759 18071 webserver.cc:460] Webserver started at http://127.11.118.129:35121/ using document root <none> and password file <none>
I20260812 09:50:49.159566 18071 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:49.159655 18071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:49.159981 18071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:49.162474 18071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "0cd7c5264e3a4e55b5ae36c8d0370ec5"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "5e9385ad5bbb354079acec8a6ed620c2"
server_key_iv: "11c983f5d7133cf09ea4b7b37a9d535d"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.163224 18071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "0cd7c5264e3a4e55b5ae36c8d0370ec5"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "5e9385ad5bbb354079acec8a6ed620c2"
server_key_iv: "11c983f5d7133cf09ea4b7b37a9d535d"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.167910 18071 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:50:49.171284 18091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.172726 18071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:49.172902 18071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "0cd7c5264e3a4e55b5ae36c8d0370ec5"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "5e9385ad5bbb354079acec8a6ed620c2"
server_key_iv: "11c983f5d7133cf09ea4b7b37a9d535d"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.173192 18071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:49.191520 18071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:49.195498 18071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:49.195729 18071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:49.196378 18071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:49.197259 18071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:49.197307 18071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.197377 18071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:49.197418 18071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.208425 18071 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:36525
I20260812 09:50:49.208446 18215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:36525 every 8 connection(s)
I20260812 09:50:49.209524 18071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:49.215898 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18071
I20260812 09:50:49.216022 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:49.216385 11738 external_mini_cluster.cc:1428] Setting key 74b9af8771911f6a5386c6a044fc0ae8
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:49.227442 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.211917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:40389 (local address 127.11.118.190:36307)
0812 09:50:49.212108 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.212112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.213008 (+ 896us) server_negotiation.cc:407] Connection header received
0812 09:50:49.214480 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.214484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.214545 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.214668 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.216140 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.216989 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.218686 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.218928 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.219124 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.222389 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.222396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.222402 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.222451 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.224700 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.225428 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.225434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.225439 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.225553 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.225970 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.225973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.225975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.226255 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.226380 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.227048 (+ 668us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.227209 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 09:50:49.228329 18218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.212239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36307 (local address 127.11.118.129:40389)
0812 09:50:49.212775 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:49.212875 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:49.214228 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:49.214893 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:49.214901 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:49.215376 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:49.215919 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.215934 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.217175 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.217179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.218537 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.218552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.219185 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.219192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.219452 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.220334 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:49.220390 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:49.222137 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:49.224888 (+ 2751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.224895 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.224914 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.225277 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.225678 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.225681 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.225683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.225853 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.226429 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:49.226435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:49.226726 (+ 291us) client_negotiation.cc:769] Sending connection context
0812 09:50:49.226923 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 09:50:49.227318 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":133,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:50:49.229980 18216 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36307
I20260812 09:50:49.230258 18216 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:49.230784 18216 heartbeater.cc:511] Master 127.11.118.190:36307 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:49.232914 18003 ts_manager.cc:194] Registered new tserver with Master: 0cd7c5264e3a4e55b5ae36c8d0370ec5 (127.11.118.129:36525)
I20260812 09:50:49.234827 18003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:40389
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:50:49.258910 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:49.383812 18221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:49.384121 18221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:49.384169 18221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:49.388512 18221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:49.388597 18221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:49.388662 18221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:49.394455 18221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:49.395830 18221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:49.396868 18221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:49.407884 18227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.408038 18226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.408057 18230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:49.408511 18221 server_base.cc:1034] running on GCE node
I20260812 09:50:49.408994 18221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:49.409687 18221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:49.410924 18221 hybrid_clock.cc:648] HybridClock initialized: now 1786528249410882 us; error 56 us; skew 500 ppm
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.414788 18221 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:50:49.415967 18221 webserver.cc:460] Webserver started at http://127.11.118.130:42827/ using document root <none> and password file <none>
I20260812 09:50:49.416646 18221 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:49.416754 18221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:49.417074 18221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:49.419495 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "6d29f778e06c47438033daade5119673"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "fba2d96075db02fb145866fd5baf2f84"
server_key_iv: "316c2b86b80f4ebb9cacb1fe61ff8636"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.420308 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "6d29f778e06c47438033daade5119673"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "fba2d96075db02fb145866fd5baf2f84"
server_key_iv: "316c2b86b80f4ebb9cacb1fe61ff8636"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.424722 18221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:49.427582 18237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.428974 18221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:49.429141 18221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "6d29f778e06c47438033daade5119673"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "fba2d96075db02fb145866fd5baf2f84"
server_key_iv: "316c2b86b80f4ebb9cacb1fe61ff8636"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.429280 18221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:49.443755 18221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:49.447520 18221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:49.447749 18221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:49.448450 18221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:49.449373 18221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:49.449452 18221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.449528 18221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:49.449575 18221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.460240 18221 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:37461
I20260812 09:50:49.460260 18365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:37461 every 8 connection(s)
I20260812 09:50:49.461258 18221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:49.468071 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18221
I20260812 09:50:49.468202 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:49.468575 11738 external_mini_cluster.cc:1428] Setting key d188f34a5ff128d13e724cd7718505ae
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:49.478057 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.463289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:44497 (local address 127.11.118.190:36307)
0812 09:50:49.463468 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.463472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.464298 (+ 826us) server_negotiation.cc:407] Connection header received
0812 09:50:49.465837 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.465841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.465895 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.465981 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.467509 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.468391 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.469857 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.470126 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.470253 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.473157 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.473162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.473167 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.473203 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.474836 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.475657 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.475663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.475665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.475773 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.476327 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.476330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.476332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.476648 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.476737 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.477645 (+ 908us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.477856 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 09:50:49.479486 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.463639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36307 (local address 127.11.118.130:44497)
0812 09:50:49.464107 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:49.464152 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:49.465520 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:49.466221 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:49.466256 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:49.466671 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:49.467322 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.467339 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.468558 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.468561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.469710 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.469721 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.470300 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.470304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.470513 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.471227 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:49.471246 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:49.472953 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:49.475002 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.475012 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.475034 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.475512 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.475924 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.475930 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.475935 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.476147 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.476778 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:49.476788 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:49.477215 (+ 427us) client_negotiation.cc:769] Sending connection context
0812 09:50:49.477580 (+ 365us) client_negotiation.cc:240] Negotiation successful
0812 09:50:49.478119 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:49.481278 18366 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36307
I20260812 09:50:49.481581 18366 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:49.482249 18366 heartbeater.cc:511] Master 127.11.118.190:36307 requested a full tablet report, sending...
I20260812 09:50:49.483728 18003 ts_manager.cc:194] Registered new tserver with Master: 6d29f778e06c47438033daade5119673 (127.11.118.130:37461)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:50:49.484561 18003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:44497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:50:49.504287 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:40517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:49.625247 18372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:49.625553 18372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:49.625602 18372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:49.629966 18372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:49.630054 18372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:49.630119 18372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:49.636126 18372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:40517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:49.637310 18372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:49.638379 18372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:49.648991 18378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.648990 18381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:49.648990 18379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:49.649134 18372 server_base.cc:1034] running on GCE node
I20260812 09:50:49.649895 18372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:49.650593 18372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:49.651827 18372 hybrid_clock.cc:648] HybridClock initialized: now 1786528249651811 us; error 31 us; skew 500 ppm
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.655143 18372 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:50:49.656345 18372 webserver.cc:460] Webserver started at http://127.11.118.131:42761/ using document root <none> and password file <none>
I20260812 09:50:49.657011 18372 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:49.657119 18372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:49.657377 18372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:49.659806 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "9b3dfbbc3a724381937f02f1827b999a"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "b994e380fcc1993afebd166ac3c3e553"
server_key_iv: "34236f06640cea7deda6ab1cc6dbb67f"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.660457 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "9b3dfbbc3a724381937f02f1827b999a"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "b994e380fcc1993afebd166ac3c3e553"
server_key_iv: "34236f06640cea7deda6ab1cc6dbb67f"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.664772 18372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:49.667651 18389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.669116 18372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:49.669236 18372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "9b3dfbbc3a724381937f02f1827b999a"
format_stamp: "Formatted at 2026-08-12 09:50:49 on dist-test-slave-2w3w"
server_key: "b994e380fcc1993afebd166ac3c3e553"
server_key_iv: "34236f06640cea7deda6ab1cc6dbb67f"
server_key_version: "encryptionkey@0"
I20260812 09:50:49.669345 18372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:49.691202 18372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:49.694849 18372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:49.695202 18372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:49.695835 18372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:49.696708 18372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:49.696760 18372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.696802 18372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:49.696818 18372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:49.706785 18372 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:45453
I20260812 09:50:49.706809 18517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:45453 every 8 connection(s)
I20260812 09:50:49.707883 18372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:49.713769 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18372
I20260812 09:50:49.713980 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:49.714298 11738 external_mini_cluster.cc:1428] Setting key 93bec9aad6ebb310d4973c40e9e9cf79
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:50:49.725015 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.710072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:53661 (local address 127.11.118.190:36307)
0812 09:50:49.710240 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.710243 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.711374 (+ 1131us) server_negotiation.cc:407] Connection header received
0812 09:50:49.712818 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.712821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.712875 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.712965 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.714556 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.715371 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.717201 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.717535 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.717629 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.720677 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.720680 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.720682 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.720712 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.722291 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.722904 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.722907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.722908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.723096 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.723682 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.723686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.723688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.723980 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.724095 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.724689 (+ 594us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.724838 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:50:49.726217 18520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.710453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36307 (local address 127.11.118.131:53661)
0812 09:50:49.711191 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:49.711242 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:49.712553 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:49.713272 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:49.713279 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:49.713698 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:49.714316 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.714332 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.715527 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.715530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.716998 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:49.717009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.717704 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.717707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:49.718081 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.718807 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:49.718826 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:49.720443 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:49.722452 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.722458 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.722474 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.722776 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.723271 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:49.723275 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:49.723277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:49.723544 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:49.724112 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:49.724120 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:49.724427 (+ 307us) client_negotiation.cc:769] Sending connection context
0812 09:50:49.724644 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 09:50:49.725033 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":233,"threads_started":1}
I20260812 09:50:49.727718 18518 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36307
I20260812 09:50:49.728021 18518 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:49.728742 18518 heartbeater.cc:511] Master 127.11.118.190:36307 requested a full tablet report, sending...
I20260812 09:50:49.730087 18003 ts_manager.cc:194] Registered new tserver with Master: 9b3dfbbc3a724381937f02f1827b999a (127.11.118.131:45453)
I20260812 09:50:49.730744 18003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:53661
I20260812 09:50:49.741707 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/test-admin.keytab.
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.765525 11738 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 09:50:49.768674 18525 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:49.767170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.11.118.129:36525)
0812 09:50:49.767554 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.767561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.767583 (+ 22us) server_negotiation.cc:407] Connection header received
0812 09:50:49.767631 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.767636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.767818 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.767978 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.768505 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59978: BlockingRecv error: recv got EOF from 127.0.0.1:59978 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":117,"threads_started":1}
W20260812 09:50:49.768920 11738 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc' of type FILE
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.770133 11738 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.771401 11738 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:49.782533 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.772424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59994 (local address 127.11.118.129:36525)
0812 09:50:49.772569 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.772574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.772700 (+ 126us) server_negotiation.cc:407] Connection header received
0812 09:50:49.772832 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.772834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.772877 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.772950 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.773571 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.774507 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.775603 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.776046 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.776145 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.779121 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.779132 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.779145 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.779172 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.780724 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.781201 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.781207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.781208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.781293 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.781550 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.781552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.781553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.781846 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.782028 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.782167 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.782348 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260812 09:50:49.787159 18525 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:49.785817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59996 (local address 127.11.118.129:36525)
0812 09:50:49.786014 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.786018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.786035 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:49.786220 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.786224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.786271 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.786346 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.787006 (+ 660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59996: BlockingRecv error: recv got EOF from 127.0.0.1:59996 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260812 09:50:49.787178 11738 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc' of type FILE
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.788394 11738 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.789670 11738 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:49.798928 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.790609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.11.118.129:36525)
0812 09:50:49.790732 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.790735 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.790805 (+ 70us) server_negotiation.cc:407] Connection header received
0812 09:50:49.790863 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.790865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.790902 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.791047 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.791565 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.792121 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.793001 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.793228 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.793313 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.795826 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.795829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.795831 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.795856 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.797262 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.797674 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.797676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.797678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.797817 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.798131 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.798134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.798136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.798332 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.798447 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.798653 (+ 206us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.798759 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 09:50:49.802127 18525 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:49.801038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60016 (local address 127.11.118.129:36525)
0812 09:50:49.801207 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.801210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.801224 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:50:49.801376 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.801378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.801418 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.801484 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.802015 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60016: BlockingRecv error: recv got EOF from 127.0.0.1:60016 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260812 09:50:49.802470 11738 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786528216186196-11738-0/krb5kdc/krb5cc)
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.803699 11738 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:49.804666 11738 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[17956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:50:49.814551 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:49.805560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60032 (local address 127.11.118.129:36525)
0812 09:50:49.805722 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:49.805725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:49.805743 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:49.805857 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:49.805860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:49.805900 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:49.805976 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:49.806522 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.807137 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.807959 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:49.808281 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:49.808385 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:49.811245 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:49.811248 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:49.811250 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:49.811278 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:49.812858 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.813307 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.813310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.813312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.813416 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:49.813686 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:49.813688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:49.813689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:49.813869 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:49.814001 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:49.814193 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 09:50:49.814335 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 09:50:49.815850 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18071
I20260812 09:50:49.825153 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18221
I20260812 09:50:49.835330 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18372
I20260812 09:50:49.846513 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 17969
2026-08-12T09:50:49Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2513 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[18541](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[18541](info): set up 2 sockets
Aug 12 09:50:49 dist-test-slave-2w3w krb5kdc[18541](info): commencing operation
krb5kdc: starting...
W20260812 09:50:51.014231 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab.
Entry for principal oryx/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab.
I20260812 09:50:51.161425 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38609
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab
--principal=oryx/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:51.286459 18555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:51.286809 18555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:51.286882 18555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:51.291204 18555 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:51.291312 18555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:51.291349 18555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:51.291388 18555 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:51.291424 18555 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:51.297232 18555 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab
--principal=oryx/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:51.298471 18555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:51.299624 18555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:51.309242 18561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:51.309455 18555 server_base.cc:1034] running on GCE node
W20260812 09:50:51.309592 18563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:51.309629 18560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:51.310300 18555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:51.311604 18555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:51.312824 18555 hybrid_clock.cc:648] HybridClock initialized: now 1786528251312796 us; error 47 us; skew 500 ppm
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:51.316545 18555 init.cc:377] Logged in from keytab as oryx/127.11.118.190@KRBTEST.COM (short username oryx)
I20260812 09:50:51.317662 18555 webserver.cc:460] Webserver started at http://127.11.118.190:44411/ using document root <none> and password file <none>
I20260812 09:50:51.318367 18555 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:51.318475 18555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:51.318727 18555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:51.321199 18555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "12fa70469c9d474490ca6f12a0f1a3bd"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "dfec07f7de69ef7589b68b269883a6c3"
server_key_iv: "b2e5f0497bb7d425c82308b89ab3dfd8"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.321873 18555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "12fa70469c9d474490ca6f12a0f1a3bd"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "dfec07f7de69ef7589b68b269883a6c3"
server_key_iv: "b2e5f0497bb7d425c82308b89ab3dfd8"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.326251 18555 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:50:51.329172 18572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.330753 18555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:51.330957 18555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "12fa70469c9d474490ca6f12a0f1a3bd"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "dfec07f7de69ef7589b68b269883a6c3"
server_key_iv: "b2e5f0497bb7d425c82308b89ab3dfd8"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.331169 18555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:51.351930 18555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:51.355701 18555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:51.355942 18555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:51.364284 18555 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:38609
I20260812 09:50:51.364596 18628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:38609 every 8 connection(s)
I20260812 09:50:51.365458 18555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:51.368505 18629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:51.370469 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18555
I20260812 09:50:51.370601 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:51.371033 11738 external_mini_cluster.cc:1428] Setting key f5c62dddf443c55fa39ca10cb2a98ce9
I20260812 09:50:51.376093 18629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Bootstrap starting.
I20260812 09:50:51.378902 18629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:51.379887 18629 log.cc:824] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:51.382189 18629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: No bootstrap required, opened a new log
I20260812 09:50:51.387187 18629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } }
I20260812 09:50:51.387468 18629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:51.387540 18629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12fa70469c9d474490ca6f12a0f1a3bd, State: Initialized, Role: FOLLOWER
I20260812 09:50:51.387557 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:51.372661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43708 (local address 127.11.118.190:38609)
0812 09:50:51.373139 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:51.373160 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:51.373205 (+ 45us) server_negotiation.cc:407] Connection header received
0812 09:50:51.374091 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:51.374118 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:51.374583 (+ 465us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:51.375005 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:51.375794 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.377235 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.378166 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.378878 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.379077 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:51.381776 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:51.381784 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:51.381802 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:51.381835 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:51.384153 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.384716 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.384724 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.384731 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.384895 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.385178 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.385181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.385183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.385737 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:51.385956 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:51.386176 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 09:50:51.386514 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":138,"threads_started":1}
I20260812 09:50:51.388015 18629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } }
I20260812 09:50:51.388185 18629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:51.388252 18629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:51.388358 18629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:51.389640 18629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } }
I20260812 09:50:51.390015 18629 leader_election.cc:302] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12fa70469c9d474490ca6f12a0f1a3bd; no voters:
I20260812 09:50:51.390363 18629 leader_election.cc:288] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:51.390544 18634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:51.390853 18634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 LEADER]: Becoming Leader. State: Replica: 12fa70469c9d474490ca6f12a0f1a3bd, State: Running, Role: LEADER
I20260812 09:50:51.391203 18634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } }
I20260812 09:50:51.391707 18629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:51.392984 18636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12fa70469c9d474490ca6f12a0f1a3bd. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } }
I20260812 09:50:51.393151 18636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:51.393193 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } }
I20260812 09:50:51.393292 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:51.393594 18644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:51.396631 18644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:51.403569 18644 catalog_manager.cc:1347] Generated new cluster ID: 88e034a1418d4819adca65b9e222476d
I20260812 09:50:51.403673 18644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:51.412686 18644 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:51.414050 18644 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:51.420974 18644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Generated new TSK 0
I20260812 09:50:51.421947 18644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
I20260812 09:50:51.463469 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:51.584175 18657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:51.584475 18657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:51.584522 18657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:51.588707 18657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:51.588794 18657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:51.588857 18657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:51.594871 18657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:51.596248 18657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:51.597374 18657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:51.608273 18662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:51.608373 18663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:51.608587 18657 server_base.cc:1034] running on GCE node
W20260812 09:50:51.608845 18666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:51.609321 18657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:51.610054 18657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:51.611264 18657 hybrid_clock.cc:648] HybridClock initialized: now 1786528251611235 us; error 43 us; skew 500 ppm
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:51.614616 18657 init.cc:377] Logged in from keytab as oryx/127.11.118.129@KRBTEST.COM (short username oryx)
I20260812 09:50:51.616024 18657 webserver.cc:460] Webserver started at http://127.11.118.129:33697/ using document root <none> and password file <none>
I20260812 09:50:51.616616 18657 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:51.616681 18657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:51.616866 18657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:51.619279 18657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "f09a0d042e776dd7972a29f9196c783c"
server_key_iv: "eadf7e91d8ad84d3aea5a36ca3b4a824"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.619880 18657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "f09a0d042e776dd7972a29f9196c783c"
server_key_iv: "eadf7e91d8ad84d3aea5a36ca3b4a824"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.624205 18657 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:51.627092 18674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.628602 18657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:50:51.628731 18657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "f09a0d042e776dd7972a29f9196c783c"
server_key_iv: "eadf7e91d8ad84d3aea5a36ca3b4a824"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.629004 18657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:51.666002 18657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:51.669806 18657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:51.670030 18657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:51.670732 18657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:51.671677 18657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:51.671729 18657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.671780 18657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:51.671839 18657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.680888 18657 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38671
I20260812 09:50:51.680979 18800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38671 every 8 connection(s)
I20260812 09:50:51.681955 18657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:51.682421 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18657
I20260812 09:50:51.682565 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:51.682914 11738 external_mini_cluster.cc:1428] Setting key dab0272e045d47fdbd0003d333465216
WARNING: no policy specified for oryx/127.11.118.130@KRBTEST.COM; defaulting to no policy
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.130@KRBTEST.COM" created.
I20260812 09:50:51.700275 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:51.684164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:38785 (local address 127.11.118.190:38609)
0812 09:50:51.684314 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:51.684319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:51.685467 (+ 1148us) server_negotiation.cc:407] Connection header received
0812 09:50:51.687392 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:51.687395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:51.687446 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:51.687523 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:51.689131 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.690095 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.691594 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.692041 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.692162 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:51.695378 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:51.695382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:51.695384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:51.695507 (+ 123us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:51.697465 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.698302 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.698305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.698306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.698431 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.698819 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.698825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.698829 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.699146 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:51.699268 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:51.699838 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 09:50:51.700000 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:50:51.700987 18803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:51.684693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:38785)
0812 09:50:51.685269 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:51.685329 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:51.687093 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:51.687773 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:51.687785 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:51.688374 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:51.688916 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:51.688932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.690282 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.690286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:51.691450 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:51.691463 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.692241 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.692244 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:51.692469 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:51.693210 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:51.693228 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:51.695150 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:51.697611 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:51.697617 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:51.697668 (+ 51us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:51.698155 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:51.698537 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:51.698540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:51.698541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:51.698697 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:51.699268 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:51.699274 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:51.699566 (+ 292us) client_negotiation.cc:769] Sending connection context
0812 09:50:51.699729 (+ 163us) client_negotiation.cc:240] Negotiation successful
0812 09:50:51.700031 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":173,"threads_started":1}
I20260812 09:50:51.702466 18801 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:51.702736 18801 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:51.703415 18801 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:51.705343 18590 ts_manager.cc:194] Registered new tserver with Master: 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:51.707130 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:38785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
I20260812 09:50:51.719622 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:51.844214 18807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:51.844561 18807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:51.844653 18807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:51.849121 18807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:51.849232 18807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:51.849335 18807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:51.855362 18807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:51.856717 18807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:51.857839 18807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:51.869478 18814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:51.869480 18816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:51.869478 18813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:51.869858 18807 server_base.cc:1034] running on GCE node
I20260812 09:50:51.870484 18807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:51.871333 18807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:51.872614 18807 hybrid_clock.cc:648] HybridClock initialized: now 1786528251872572 us; error 59 us; skew 500 ppm
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:51.876067 18807 init.cc:377] Logged in from keytab as oryx/127.11.118.130@KRBTEST.COM (short username oryx)
I20260812 09:50:51.877398 18807 webserver.cc:460] Webserver started at http://127.11.118.130:43305/ using document root <none> and password file <none>
I20260812 09:50:51.878006 18807 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:51.878075 18807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:51.878268 18807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:51.880627 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "17b41e879cea4ab08e5c216541a67684"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "2789c5f0858a1f7a0856fde9d4b2a293"
server_key_iv: "b329b62785a5ae8aa39fb76809f9b0ad"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.881253 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "17b41e879cea4ab08e5c216541a67684"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "2789c5f0858a1f7a0856fde9d4b2a293"
server_key_iv: "b329b62785a5ae8aa39fb76809f9b0ad"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.885535 18807 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:51.888433 18825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.889889 18807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:51.890021 18807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "17b41e879cea4ab08e5c216541a67684"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "2789c5f0858a1f7a0856fde9d4b2a293"
server_key_iv: "b329b62785a5ae8aa39fb76809f9b0ad"
server_key_version: "encryptionkey@0"
I20260812 09:50:51.890141 18807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:51.926030 18807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:51.930159 18807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:51.930364 18807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:51.931036 18807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:51.931934 18807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:51.931982 18807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.932024 18807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:51.932040 18807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:51.942672 18807 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45939
I20260812 09:50:51.942695 18949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45939 every 8 connection(s)
I20260812 09:50:51.943780 18807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:51.948693 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18807
I20260812 09:50:51.948796 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:51.949172 11738 external_mini_cluster.cc:1428] Setting key 0da3efdaafa03550227cd7c3fe9888b9
Aug 12 09:50:51 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:50:51.961283 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:51.946009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:47515 (local address 127.11.118.190:38609)
0812 09:50:51.946172 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:51.946176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:51.947271 (+ 1095us) server_negotiation.cc:407] Connection header received
0812 09:50:51.948213 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:51.948217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:51.948290 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:51.948429 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:51.949964 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.950776 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.952845 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.953100 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.953249 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:51.957129 (+ 3880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:51.957132 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:51.957134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:51.957163 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:51.958746 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.959449 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.959453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.959455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.959555 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:51.959960 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:51.959964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:51.959966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:51.960262 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:51.960384 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:51.960971 (+ 587us) server_negotiation.cc:299] Negotiation successful
0812 09:50:51.961111 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:50:51.962322 18952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:51.946228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:47515)
0812 09:50:51.947082 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:51.947130 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:51.947989 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:51.948605 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:51.948612 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:51.949112 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:51.949666 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:51.949681 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.951054 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.951059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:51.952641 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:51.952657 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:51.953295 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:51.953302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:51.953559 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:51.954637 (+ 1078us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:51.954663 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:51.956885 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:51.958937 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:51.958945 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:51.958992 (+ 47us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:51.959313 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:51.959661 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:51.959665 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:51.959667 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:51.959843 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:51.960391 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:51.960401 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:51.960697 (+ 296us) client_negotiation.cc:769] Sending connection context
0812 09:50:51.960905 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 09:50:51.961284 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":138,"threads_started":1}
I20260812 09:50:51.963802 18950 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:51.964126 18950 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.131@KRBTEST.COM" created.
I20260812 09:50:51.964876 18950 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:51.966260 18590 ts_manager.cc:194] Registered new tserver with Master: 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
I20260812 09:50:51.967008 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:47515
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
I20260812 09:50:51.987787 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:52.118232 18955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:52.118573 18955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:52.118623 18955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:52.123150 18955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:52.123234 18955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:52.123301 18955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:52.129011 18955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:52.130138 18955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:52.131313 18955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:52.142431 18961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.142441 18965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.142445 18962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:52.142882 18955 server_base.cc:1034] running on GCE node
I20260812 09:50:52.143339 18955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:52.143985 18955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:52.145171 18955 hybrid_clock.cc:648] HybridClock initialized: now 1786528252145130 us; error 52 us; skew 500 ppm
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:52.148597 18955 init.cc:377] Logged in from keytab as oryx/127.11.118.131@KRBTEST.COM (short username oryx)
I20260812 09:50:52.149746 18955 webserver.cc:460] Webserver started at http://127.11.118.131:44869/ using document root <none> and password file <none>
I20260812 09:50:52.150415 18955 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:52.150525 18955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:52.150766 18955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:52.153031 18955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "37fc0c005b7c4a219683d83706475666"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "a34767bde06f80f10ef0b392b6abc789"
server_key_iv: "f575c4a0c1a40e8700ab0dbafd64ab04"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.153663 18955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "37fc0c005b7c4a219683d83706475666"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "a34767bde06f80f10ef0b392b6abc789"
server_key_iv: "f575c4a0c1a40e8700ab0dbafd64ab04"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.158203 18955 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:50:52.161008 18977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.162492 18955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 09:50:52.162667 18955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "37fc0c005b7c4a219683d83706475666"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "a34767bde06f80f10ef0b392b6abc789"
server_key_iv: "f575c4a0c1a40e8700ab0dbafd64ab04"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.162832 18955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:52.198695 18955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:52.202489 18955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:52.202728 18955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:52.203459 18955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:52.204371 18955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:52.204447 18955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.204519 18955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:52.204551 18955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.214465 18955 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:43495
I20260812 09:50:52.214493 19104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:43495 every 8 connection(s)
I20260812 09:50:52.215552 18955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:52.218343 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 18955
I20260812 09:50:52.218501 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:52.218828 11738 external_mini_cluster.cc:1428] Setting key 896d4d97ca45aadb24da99b89c81eda3
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:52.230298 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.217556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:39985 (local address 127.11.118.190:38609)
0812 09:50:52.217742 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.217755 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.218633 (+ 878us) server_negotiation.cc:407] Connection header received
0812 09:50:52.220098 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.220101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.220161 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.220246 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.221593 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.222142 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.223422 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.223645 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.223734 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.226426 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.226430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.226432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.226457 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.227957 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.228588 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.228591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.228592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.228688 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.229155 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.229158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.229159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.229377 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.229470 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.230042 (+ 572us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.230168 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 09:50:52.231287 19107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.217952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:39985)
0812 09:50:52.218470 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.218526 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.219877 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.220468 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.220475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.220861 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.221461 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.221476 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.222274 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.222276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.223286 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.223296 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.223785 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.223788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.223946 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.224564 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.224580 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.226220 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.228107 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.228112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.228125 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.228454 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.228847 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.228849 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.228851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.229009 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.229483 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.229489 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.229758 (+ 269us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.229940 (+ 182us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.230225 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":160,"threads_started":1}
I20260812 09:50:52.232709 19105 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:52.232973 19105 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:52.233564 19105 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:52.234836 18590 ts_manager.cc:194] Registered new tserver with Master: 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495)
I20260812 09:50:52.235599 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:39985
I20260812 09:50:52.245420 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.118.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.189.keytab.
Entry for principal oryx/127.11.118.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.189.keytab.
I20260812 09:50:52.284760 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:42445
--webserver_interface=127.11.118.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.189.keytab
--principal=oryx/127.11.118.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38609,127.11.118.189:42445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:52.409875 19110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:52.410167 19110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:52.410209 19110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:52.414420 19110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:52.414520 19110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:52.414541 19110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:52.414562 19110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:52.414578 19110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:52.420478 19110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38609,127.11.118.189:42445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.189.keytab
--principal=oryx/127.11.118.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:42445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.118.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
W20260812 09:50:52.420735 19110 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.118.190:38609,127.11.118.189:42445'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 09:50:52.421665 19110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:52.422708 19110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:52.432246 19117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.432246 19119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.432349 19115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:52.433022 19110 server_base.cc:1034] running on GCE node
I20260812 09:50:52.433780 19110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:52.435274 19110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:52.436522 19110 hybrid_clock.cc:648] HybridClock initialized: now 1786528252436480 us; error 64 us; skew 500 ppm
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:52.439994 19110 init.cc:377] Logged in from keytab as oryx/127.11.118.189@KRBTEST.COM (short username oryx)
I20260812 09:50:52.441092 19110 webserver.cc:460] Webserver started at http://127.11.118.189:41779/ using document root <none> and password file <none>
I20260812 09:50:52.441672 19110 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:52.441744 19110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:52.441926 19110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:52.444319 19110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/instance:
uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "be136501b25e08cc81e9fd6c52a75966"
server_key_iv: "08bc81657e225bf00cd2af0d286d4b8f"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.444977 19110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal/instance:
uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "be136501b25e08cc81e9fd6c52a75966"
server_key_iv: "08bc81657e225bf00cd2af0d286d4b8f"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.449262 19110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:50:52.452358 19127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.453915 19110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:52.454049 19110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "be136501b25e08cc81e9fd6c52a75966"
server_key_iv: "08bc81657e225bf00cd2af0d286d4b8f"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.454219 19110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:52.485507 19110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:52.489216 19110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:52.489466 19110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:52.497869 19110 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.189:42445
I20260812 09:50:52.498215 19184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.189:42445 every 8 connection(s)
I20260812 09:50:52.499084 19110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
I20260812 09:50:52.502076 19185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:52.503438 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 19110
I20260812 09:50:52.506958 19185 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.189@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:52.519447 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.509219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43716 (local address 127.11.118.190:38609)
0812 09:50:52.509600 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.509605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.509758 (+ 153us) server_negotiation.cc:407] Connection header received
0812 09:50:52.510020 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.510023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.510070 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.510142 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.511166 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.511719 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.512857 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.513141 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.513263 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.516011 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.516015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.516017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.516044 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.517452 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.517950 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.517954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.517956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.518038 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.518373 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.518377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.518382 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.518614 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.518727 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.519128 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.519255 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260812 09:50:52.520644 19189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.509092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43716)
0812 09:50:52.509587 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.509649 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.509891 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.510256 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.510262 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.510804 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.510943 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.510949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.511870 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.511873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.512701 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.512711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.513316 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.513321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.513441 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.513991 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.514018 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.515839 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.517576 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.517586 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.517597 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.517833 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.518135 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.518139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.518141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.518274 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.518726 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.518733 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.518878 (+ 145us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.519087 (+ 209us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.519612 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":176,"thread_start_us":130,"threads_started":1}
I20260812 09:50:52.520644 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.505111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53432 (local address 127.11.118.189:42445)
0812 09:50:52.505600 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.505616 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.505656 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:50:52.506325 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.506342 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.506685 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.507070 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.508008 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.509318 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.510738 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.511410 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.511605 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.514808 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.514815 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.514826 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.514849 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.517202 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.517715 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.517726 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.517728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.517852 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.518159 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.518164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.518166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.518591 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.518818 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.519100 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.519555 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":327,"thread_start_us":173,"threads_started":1}
I20260812 09:50:52.522389 19185 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.189@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
I20260812 09:50:52.532398 19189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.522947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53436)
0812 09:50:52.523091 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.523107 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.523185 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.523645 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.523647 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.523789 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.523904 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.523911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.525379 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.525383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.526193 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.526202 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.526674 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.526677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.526754 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.527304 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.527321 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.528759 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.530631 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.530633 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.530635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.530842 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.531290 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.531293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.531294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.531414 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.531916 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.531918 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.532006 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.532111 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.532236 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 09:50:52.532673 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.523348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.11.118.189:42445)
0812 09:50:52.523462 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.523465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.523476 (+ 11us) server_negotiation.cc:407] Connection header received
0812 09:50:52.523505 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.523507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.523540 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.523603 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.524118 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.525221 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.526331 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.526567 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.526679 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.528931 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.528934 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.528936 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.528958 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.530499 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.530954 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.530957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.531033 (+ 76us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.531154 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.531545 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.531548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.531549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.531754 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.531905 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.532261 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.532452 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 09:50:52.536027 19185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Bootstrap starting.
I20260812 09:50:52.538456 19185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:52.539345 19185 log.cc:824] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:52.541574 19185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: No bootstrap required, opened a new log
I20260812 09:50:52.544844 19185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } }
I20260812 09:50:52.545101 19185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:52.545138 19185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a72fa501ade4c31bf02ac0f481f0ba9, State: Initialized, Role: FOLLOWER
I20260812 09:50:52.545631 19185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } }
I20260812 09:50:52.546221 19191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } } }
I20260812 09:50:52.546392 19191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:52.546947 19185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 09:50:52.552711 19202 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:50:52.552853 19202 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:50:52.555382 19110 master_runner.cc:428] Detected that this master 3a72fa501ade4c31bf02ac0f481f0ba9 is joining an existing cluster
I20260812 09:50:52.555456 19110 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.118.189:42445
I20260812 09:50:52.567137 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.558008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43722 (local address 127.11.118.190:38609)
0812 09:50:52.558173 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.558178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.558462 (+ 284us) server_negotiation.cc:407] Connection header received
0812 09:50:52.558681 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.558685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.558745 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.558822 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.559628 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.560507 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.561589 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.561916 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.562037 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.563472 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.563476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.563478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.563511 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.565220 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565680 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.565684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.565685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.565789 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.566136 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.566140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.566141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.566381 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.566486 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.566756 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.566891 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 09:50:52.567137 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.558543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53452 (local address 127.11.118.189:42445)
0812 09:50:52.558672 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.558676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.559019 (+ 343us) server_negotiation.cc:407] Connection header received
0812 09:50:52.559095 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.559098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.559146 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.559241 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.559719 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.560223 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.561303 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.561659 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.561780 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.563281 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.563285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.563288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.563311 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.564957 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565475 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.565479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.565480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.565580 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565874 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.565878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.565879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.566185 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.566264 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.566799 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.566938 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":46}
I20260812 09:50:52.567967 19211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.558431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53452)
0812 09:50:52.558886 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.558900 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.559012 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.559285 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.559288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.559476 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.559615 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.559621 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.560333 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.560336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.561167 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.561176 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.561812 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.561815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.561907 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.562512 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.562534 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.563123 (+ 589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.565099 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565102 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.565105 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.565350 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.565686 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.565691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.565770 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.566538 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.566541 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.566637 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.566876 (+ 239us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.567080 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":91,"threads_started":1}
I20260812 09:50:52.568081 19209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.557919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43722)
0812 09:50:52.558382 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.558396 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.558549 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.559013 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.559016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.559301 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.559482 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.559491 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.560647 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.560651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.561469 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.561476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.562048 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.562052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.562163 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.562668 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.562683 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.563292 (+ 609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.565345 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565348 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.565350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.565574 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.565916 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.565919 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.565921 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.566021 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.566487 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.566489 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.566571 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.566691 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.567351 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":119,"threads_started":1}
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.190@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.118.188@KRBTEST.COM; defaulting to no policy
I20260812 09:50:52.585845 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.573586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.11.118.189:42445)
0812 09:50:52.574304 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.574311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.574327 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:50:52.574399 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.574402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.574464 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.574762 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.575601 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.576227 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.577311 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.577714 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.577804 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.581237 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.581242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.581246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.581278 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.583374 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.584131 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.584138 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.584141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.584250 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.584618 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.584622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.584623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.584907 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.585027 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.585481 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.585624 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632}
I20260812 09:50:52.585855 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.573517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53456)
0812 09:50:52.573976 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.574040 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.574180 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.574821 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.574828 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.575334 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.575470 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.575478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.576417 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.576421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.577121 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.577137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.578014 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.578019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.578175 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.579062 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.579080 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.581024 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.583563 (+ 2539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.583579 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.583587 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.583987 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.584379 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.584382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.584384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.584496 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.585043 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.585051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.585205 (+ 154us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.585384 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.585646 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":123,"threads_started":1}
I20260812 09:50:52.587733 18590 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.118.189:42445: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
member_type: NON_VOTER
last_known_addr {
host: "127.11.118.189"
port: 42445
}
attrs {
promote: true
}
}
dest_uuid: "12fa70469c9d474490ca6f12a0f1a3bd"
cas_config_opid_index: -1
I20260812 09:50:52.588613 18590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.188@KRBTEST.COM" created.
I20260812 09:50:52.591149 19215 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } }
I20260812 09:50:52.592092 19155 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:52.593250 19215 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.118.189:42445
I20260812 09:50:52.593701 19155 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 09:50:52.593875 19110 master.cc:537] Master@127.11.118.189:42445 shutting down...
I20260812 09:50:52.594643 19217 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:52.595546 19220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } }
I20260812 09:50:52.595671 19220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
W20260812 09:50:52.597111 18576 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 09:50:52.598078 18576 consensus_peers.cc:487] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd -> Peer 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189:42445): Couldn't send request to peer 3a72fa501ade4c31bf02ac0f481f0ba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 09:50:52.599812 19110 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:52.600139 19110 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:52.600252 19110 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: stopping tablet replica
I20260812 09:50:52.616621 19110 master.cc:552] Master@127.11.118.189:42445 shutdown complete.
I20260812 09:50:52.616703 19110 master_runner.cc:305] Clearing existing system tablet
I20260812 09:50:52.616977 19110 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:52.617040 19110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:52.618801 19110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.003s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.188.keytab.
Entry for principal oryx/127.11.118.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.188.keytab.
I20260812 09:50:52.619997 19226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.620198 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:34409
--webserver_interface=127.11.118.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.188.keytab
--principal=oryx/127.11.118.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:50:52.620246 19110 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:52.620381 19110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 09:50:52.620419 19110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "be136501b25e08cc81e9fd6c52a75966"
server_key_iv: "08bc81657e225bf00cd2af0d286d4b8f"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.623524 19110 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:52.626143 19110 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 09:50:52.626257 19110 log.cc:1196] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 09:50:52.626538 19110 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Deleting consensus metadata
I20260812 09:50:52.626761 19110 master_runner.cc:315] Copying system tablet from 127.11.118.190:38609
I20260812 09:50:52.628638 19110 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: tablet copy: Beginning tablet copy session from remote peer at address 127.11.118.190:38609
I20260812 09:50:52.641135 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.629536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43734)
0812 09:50:52.629918 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.629935 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.630080 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.630448 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.630451 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.630728 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.630904 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.630912 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.632181 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.632185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.633252 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.633266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.633982 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.633987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.634115 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.634860 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.634877 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.635477 (+ 600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.637722 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.637726 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.637728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.638016 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.639646 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.639650 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.639653 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.639790 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.640434 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.640438 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.640565 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.640678 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.640879 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":106,"threads_started":1}
I20260812 09:50:52.641175 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.629599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43734 (local address 127.11.118.190:38609)
0812 09:50:52.629756 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.629762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.630057 (+ 295us) server_negotiation.cc:407] Connection header received
0812 09:50:52.630202 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.630207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.630280 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.630399 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.631094 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.632032 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.633415 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.633837 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.633966 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.635665 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.635669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.635672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.635702 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.637549 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.638134 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.638138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.638140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.638240 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.640004 (+ 1764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.640008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.640010 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.640310 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.640433 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.640795 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.640949 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:50:52.642205 18612 tablet_copy_service.cc:140] P 12fa70469c9d474490ca6f12a0f1a3bd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a72fa501ade4c31bf02ac0f481f0ba9 ({username='oryx', principal='oryx/127.11.118.189@KRBTEST.COM'} at 127.0.0.1:43734)
I20260812 09:50:52.642433 18612 tablet_copy_service.cc:161] P 12fa70469c9d474490ca6f12a0f1a3bd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a72fa501ade4c31bf02ac0f481f0ba9 at {username='oryx', principal='oryx/127.11.118.189@KRBTEST.COM'} at 127.0.0.1:43734: session id = 3a72fa501ade4c31bf02ac0f481f0ba9-00000000000000000000000000000000
I20260812 09:50:52.644670 18612 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 09:50:52.646950 19110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 09:50:52.649891 19110 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: tablet copy: Starting download of 0 data blocks...
I20260812 09:50:52.650118 19110 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: tablet copy: Starting download of 1 WAL segments...
I20260812 09:50:52.652527 19110 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 09:50:52.655056 18612 tablet_copy_service.cc:342] P 12fa70469c9d474490ca6f12a0f1a3bd: Request end of tablet copy session 3a72fa501ade4c31bf02ac0f481f0ba9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.118.189@KRBTEST.COM'} at 127.0.0.1:43734
I20260812 09:50:52.655243 18612 tablet_copy_service.cc:433] P 12fa70469c9d474490ca6f12a0f1a3bd: ending tablet copy session 3a72fa501ade4c31bf02ac0f481f0ba9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a72fa501ade4c31bf02ac0f481f0ba9
I20260812 09:50:52.664319 19110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:52.666488 19237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.666692 19234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:52.667807 19110 server_base.cc:1034] running on GCE node
W20260812 09:50:52.668135 19235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:52.668381 19110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:52.668743 19110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:52.676159 19110 hybrid_clock.cc:648] HybridClock initialized: now 1786528252676133 us; error 55 us; skew 500 ppm
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:52.686213 19110 init.cc:377] Logged in from keytab as oryx/127.11.118.189@KRBTEST.COM (short username oryx)
I20260812 09:50:52.686851 19110 webserver.cc:460] Webserver started at http://127.11.118.189:40267/ using document root <none> and password file <none>
I20260812 09:50:52.687143 19110 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:52.687199 19110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:52.688797 19110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:52.689977 19246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.690320 19110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:52.690411 19110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "be136501b25e08cc81e9fd6c52a75966"
server_key_iv: "08bc81657e225bf00cd2af0d286d4b8f"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.690507 19110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:52.708293 19110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:52.710197 18801 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:52.711192 19110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:52.717710 19110 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.189:42445
I20260812 09:50:52.717797 19301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.189:42445 every 8 connection(s)
I20260812 09:50:52.718811 19110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
I20260812 09:50:52.720947 19302 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:50:52.722218 19302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Bootstrap starting.
I20260812 09:50:52.735031 19302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:50:52.736105 19302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: Bootstrap complete.
I20260812 09:50:52.736855 19302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } }
I20260812 09:50:52.737015 19302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a72fa501ade4c31bf02ac0f481f0ba9, State: Initialized, Role: LEARNER
I20260812 09:50:52.737118 19302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } }
I20260812 09:50:52.737635 19302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:52.740839 19305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } }
I20260812 09:50:52.741007 19305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: LEARNER
I20260812 09:50:52.743506 19317 catalog_manager.cc:1259] Loaded cluster ID: 88e034a1418d4819adca65b9e222476d
I20260812 09:50:52.743641 19317 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: loading cluster ID for follower catalog manager: success
I20260812 09:50:52.745975 19317 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: acquiring CA information for follower catalog manager: success
I20260812 09:50:52.747795 19317 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 09:50:52.773658 19227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:52.774021 19227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:52.774106 19227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:52.778800 19227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:52.779121 19227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:52.779215 19227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:52.779258 19227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:52.779296 19227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:52.786180 19227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.188.keytab
--principal=oryx/127.11.118.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:34409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.118.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:52.787568 19227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:52.788728 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:50:52.799407 19227 server_base.cc:1034] running on GCE node
W20260812 09:50:52.799292 19324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.799315 19327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:52.799322 19323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:52.800267 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:52.801571 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:52.802811 19227 hybrid_clock.cc:648] HybridClock initialized: now 1786528252802752 us; error 77 us; skew 500 ppm
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:52.806245 19227 init.cc:377] Logged in from keytab as oryx/127.11.118.188@KRBTEST.COM (short username oryx)
I20260812 09:50:52.807436 19227 webserver.cc:460] Webserver started at http://127.11.118.188:38865/ using document root <none> and password file <none>
I20260812 09:50:52.808084 19227 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:52.808197 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:52.808465 19227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:52.810786 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/instance:
uuid: "9faa44432c6949fcab94cd7263011e63"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "d04a1491e5a0d5a77b1873cedcca9762"
server_key_iv: "8431dfca9151d65267d67515de4a3db7"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.811480 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal/instance:
uuid: "9faa44432c6949fcab94cd7263011e63"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "d04a1491e5a0d5a77b1873cedcca9762"
server_key_iv: "8431dfca9151d65267d67515de4a3db7"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.816133 19227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:52.819815 19337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:52.821558 19227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:50:52.821713 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "9faa44432c6949fcab94cd7263011e63"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "d04a1491e5a0d5a77b1873cedcca9762"
server_key_iv: "8431dfca9151d65267d67515de4a3db7"
server_key_version: "encryptionkey@0"
I20260812 09:50:52.821836 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:52.840442 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:52.844457 19227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:52.844650 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:52.853149 19227 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.188:34409
I20260812 09:50:52.853538 19393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.188:34409 every 8 connection(s)
I20260812 09:50:52.854308 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
I20260812 09:50:52.857957 19394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:52.861347 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 19227
I20260812 09:50:52.862666 19394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.188@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
I20260812 09:50:52.878705 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.864775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43748 (local address 127.11.118.190:38609)
0812 09:50:52.864981 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.864986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.865123 (+ 137us) server_negotiation.cc:407] Connection header received
0812 09:50:52.865362 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.865366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.865419 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.865506 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.866685 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.867599 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.869224 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.869575 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.869703 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.873461 (+ 3758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.873469 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.873475 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.873522 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.876147 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.876877 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.876881 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.876883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.876990 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.877419 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.877422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.877424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.877652 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.877774 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.878371 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.878519 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260812 09:50:52.879823 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.863171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43970 (local address 127.11.118.188:34409)
0812 09:50:52.863664 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.863681 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.863720 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:50:52.864572 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.864596 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.865024 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.865350 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.866404 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.867828 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.869103 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.869812 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.870007 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.873933 (+ 3926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.873941 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.873955 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.873983 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.876706 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.877252 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.877258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.877259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.877342 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.877660 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.877663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.877665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.878079 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.878330 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.878562 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.878811 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":323,"thread_start_us":164,"threads_started":1}
I20260812 09:50:52.879830 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.864572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43748)
0812 09:50:52.864961 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.865019 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.865191 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.865602 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.865609 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.866164 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.866532 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.866545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.867751 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.867754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.869088 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.869099 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.869771 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.869774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.870000 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.870949 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.870972 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.873213 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.876324 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.876335 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.876346 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.876719 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.877104 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.877107 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.877109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.877276 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.877770 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.877778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.878100 (+ 322us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.878297 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.878693 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":2,"thread_start_us":116,"threads_started":1}
I20260812 09:50:52.882017 19394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.188@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
I20260812 09:50:52.892328 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.882656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53460)
0812 09:50:52.882923 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.882939 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.883064 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.883571 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.883573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.883788 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.883953 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.883960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.884898 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.884901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.885482 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.885489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.886055 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.886060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.886166 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.886835 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.886848 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.888411 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.890442 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.890449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.890454 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.890714 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.891076 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.891080 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.891083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.891190 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.891646 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.891649 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.891753 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.891912 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.892099 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 09:50:52.892345 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.882945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53460 (local address 127.11.118.189:42445)
0812 09:50:52.883301 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.883305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.883318 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:50:52.883359 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.883361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.883428 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.883507 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.884074 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.884774 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.885625 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.885894 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.885989 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.888579 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.888582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.888584 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.888611 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.890170 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.890841 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.890844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.890846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.890949 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.891330 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.891332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.891333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.891542 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.891630 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.891982 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.892120 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":133,"threads_started":1}
I20260812 09:50:52.893440 19394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528252, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.188@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
I20260812 09:50:52.902192 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.894012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:43980)
0812 09:50:52.894192 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.894205 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.894306 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.894544 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.894547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.894703 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.894840 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.894846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.895833 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.895836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.896430 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.896439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.896882 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.896885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.896949 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.897413 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.897425 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.898760 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.900589 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.900591 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.900593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.900795 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.901147 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.901149 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.901151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.901256 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.901669 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.901671 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.901753 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.901886 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.902016 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 09:50:52.902205 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.894187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43980 (local address 127.11.118.188:34409)
0812 09:50:52.894321 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.894324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.894337 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:50:52.894373 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.894375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.894415 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.894484 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.895020 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.895683 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.896545 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.896777 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.896857 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.898896 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.898899 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.898901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.898930 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.900467 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.900883 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.900885 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.900886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.900964 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.901363 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.901365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.901366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.901573 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.901655 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.901947 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.902077 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":61}
I20260812 09:50:52.905712 19394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Bootstrap starting.
I20260812 09:50:52.908260 19394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:52.909034 19394 log.cc:824] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:52.911402 19394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: No bootstrap required, opened a new log
I20260812 09:50:52.914633 19394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } }
I20260812 09:50:52.914942 19394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:52.915079 19394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9faa44432c6949fcab94cd7263011e63, State: Initialized, Role: FOLLOWER
I20260812 09:50:52.915575 19394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } }
I20260812 09:50:52.916143 19400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } } }
I20260812 09:50:52.916366 19400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:52.916972 19394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 09:50:52.922542 19411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:50:52.922658 19411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:50:52.927124 19227 master_runner.cc:428] Detected that this master 9faa44432c6949fcab94cd7263011e63 is joining an existing cluster
I20260812 09:50:52.927222 19227 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.118.188:34409
I20260812 09:50:52.933749 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18657
I20260812 09:50:52.946777 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:38671
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:38609
--webserver_port=33697
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:50:52.966099 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.930133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43758 (local address 127.11.118.190:38609)
0812 09:50:52.930311 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.930317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.930497 (+ 180us) server_negotiation.cc:407] Connection header received
0812 09:50:52.930624 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.930627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.930684 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.930781 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.931532 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.932404 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.936028 (+ 3624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.936419 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.936510 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.938318 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.938322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.938325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.938353 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.940176 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.964384 (+ 24208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.964390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.964392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.964530 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.965025 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.965028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.965030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.965291 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.965395 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.965770 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.965920 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:50:52.966918 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.929968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43758)
0812 09:50:52.930380 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.930397 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.930532 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.930928 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.930932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.931203 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.931361 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.931370 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.933390 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.933393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.935869 (+ 2476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.935881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.936737 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.936742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.936860 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.937500 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.937515 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.938082 (+ 567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.940331 (+ 2249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.940336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.940338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.964154 (+ 23816us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.964672 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.964675 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.964677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.964894 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.965456 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.965459 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.965564 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.966315 (+ 751us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.966498 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"spinlock_wait_cycles":8064,"thread_start_us":134,"threads_started":1}
I20260812 09:50:52.969529 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.930891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53472)
0812 09:50:52.931248 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.931262 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.931401 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.931805 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.931807 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.931980 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.932074 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.932079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.933148 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.933153 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.934695 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.934710 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.939607 (+ 4897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.939610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.939739 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.941019 (+ 1280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.941040 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.964154 (+ 23114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.967031 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.967036 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.967040 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.968064 (+ 1024us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.968382 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.968386 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.968388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.968470 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.968986 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.968989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.969086 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.969177 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.969335 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"spinlock_wait_cycles":17280,"thread_start_us":153,"threads_started":1}
I20260812 09:50:52.970032 18950 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:52.970080 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.930679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53472 (local address 127.11.118.189:42445)
0812 09:50:52.930859 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.930864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.931331 (+ 467us) server_negotiation.cc:407] Connection header received
0812 09:50:52.931521 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.931525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.931581 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.931642 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.932218 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.933047 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.938823 (+ 5776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.939321 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.939450 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.964401 (+ 24951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.964406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.964409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.964445 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.966775 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.968175 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.968179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.968181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.968277 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.968582 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.968588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.968590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.968841 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.968938 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.969779 (+ 841us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.969929 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260812 09:50:52.972877 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.931361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.11.118.188:34409)
0812 09:50:52.931475 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.931482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.932394 (+ 912us) server_negotiation.cc:407] Connection header received
0812 09:50:52.932526 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.932529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.932560 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.932602 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.940009 (+ 7407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.940857 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.942356 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.942694 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.942796 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.965071 (+ 22275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.965075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.965078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.965105 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.967802 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.971585 (+ 3783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.971588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.971590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.971672 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.971961 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.971964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.971966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.972199 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.972287 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.972588 (+ 301us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.972710 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 09:50:52.973343 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.931542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:43992)
0812 09:50:52.932321 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.932334 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.932442 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.932737 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.932740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.932942 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.933056 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.933063 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.941163 (+ 8100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.941169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.942198 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.942216 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.942929 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.942933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.943053 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.943521 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.943535 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.964874 (+ 21339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.971177 (+ 6303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.971180 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.971182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.971468 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.971785 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.971788 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.971790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.971873 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.972332 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.972335 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.972420 (+ 85us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.972989 (+ 569us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.973145 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":89,"threads_started":1}
Aug 12 09:50:52 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528251, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.190@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
I20260812 09:50:52.981667 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.972619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:43998)
0812 09:50:52.972862 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.972877 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.972958 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.973944 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.973947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.974138 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:52.974280 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.974292 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.975148 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.975152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.975717 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.975725 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.976225 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.976238 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.976349 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.976879 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:52.976892 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:52.978218 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:52.980070 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.980075 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.980077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.980291 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.980598 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:52.980601 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:52.980603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:52.980693 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:52.981097 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:52.981102 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:52.981207 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.981319 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.981501 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260812 09:50:52.981667 19396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.973123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43998 (local address 127.11.118.188:34409)
0812 09:50:52.973673 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.973677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.973688 (+ 11us) server_negotiation.cc:407] Connection header received
0812 09:50:52.973750 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.973754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.973811 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.973922 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:52.974410 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.975036 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.975858 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.976090 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.976207 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.978374 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:52.978377 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:52.978379 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:52.978402 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:52.979945 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.980404 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.980408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.980409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.980492 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:52.980789 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:52.980793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:52.980795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:52.980985 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:52.981094 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.981380 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.981495 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476}
I20260812 09:50:52.983067 18590 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.118.188:34409: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9faa44432c6949fcab94cd7263011e63"
member_type: NON_VOTER
last_known_addr {
host: "127.11.118.188"
port: 34409
}
attrs {
promote: true
}
}
dest_uuid: "12fa70469c9d474490ca6f12a0f1a3bd"
cas_config_opid_index: 5
I20260812 09:50:52.983664 18590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } }
I20260812 09:50:52.984802 19220 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9faa44432c6949fcab94cd7263011e63 (127.11.118.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:52.986024 19366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:52.986513 19220 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.118.188:34409
I20260812 09:50:52.986688 19220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:52.986780 19220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:52.987596 19366 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 09:50:52.987613 19227 master.cc:537] Master@127.11.118.188:34409 shutting down...
I20260812 09:50:52.988636 19217 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:50:52.991001 18576 consensus_peers.cc:487] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd -> Peer 9faa44432c6949fcab94cd7263011e63 (127.11.118.188:34409): Couldn't send request to peer 9faa44432c6949fcab94cd7263011e63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 09:50:52.994519 19227 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:52.995113 19227 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:52.995368 19227 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: stopping tablet replica
I20260812 09:50:52.998090 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.985122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53484)
0812 09:50:52.992208 (+ 7086us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:52.992231 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:52.992361 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:52.992889 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:52.992893 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:52.992916 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:52.993019 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.993025 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.994785 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.994792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.996233 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:52.996249 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.997530 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.997534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:52.997652 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.997712 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 09:50:52.997810 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 09:50:52.997927 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6967}
I20260812 09:50:52.998505 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:52.985385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.11.118.189:42445)
0812 09:50:52.989612 (+ 4227us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:52.989617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:52.992462 (+ 2845us) server_negotiation.cc:407] Connection header received
0812 09:50:52.992532 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:52.992538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:52.992606 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:52.992697 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:52.993206 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.993887 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.996410 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:52.997114 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:52.997242 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:52.997403 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:52.998278 (+ 875us) server_negotiation.cc:299] Negotiation successful
0812 09:50:52.998388 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4109}
I20260812 09:50:52.999459 19275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 LEARNER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 09:50:53.000001 19217 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 09:50:53.002146 19227 master.cc:552] Master@127.11.118.188:34409 shutdown complete.
I20260812 09:50:53.002254 19227 master_runner.cc:305] Clearing existing system tablet
I20260812 09:50:53.002120 19275 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9faa44432c6949fcab94cd7263011e63 (127.11.118.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.002669 19227 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:53.002768 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:53.004344 19305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12fa70469c9d474490ca6f12a0f1a3bd. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.004479 19305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: LEARNER
I20260812 09:50:53.004578 19305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: NON_VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: true } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.004671 19305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: LEARNER
I20260812 09:50:53.005720 19217 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: attempting to promote NON_VOTER 3a72fa501ade4c31bf02ac0f481f0ba9 to VOTER
I20260812 09:50:53.006193 19217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } }
I20260812 09:50:53.007843 19275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 LEARNER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 09:50:53.007655 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.007348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:44000)
0812 09:50:53.007480 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.007569 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:34409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 09:50:53.008487 19215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 09:50:53.009123 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.008899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:44014)
0812 09:50:53.008991 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.009051 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:34409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 09:50:53.009830 18576 consensus_peers.cc:487] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd -> Peer 9faa44432c6949fcab94cd7263011e63 (127.11.118.188:34409): Couldn't send request to peer 9faa44432c6949fcab94cd7263011e63. Status: Network error: Client connection negotiation failed: client connection to 127.11.118.188:34409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 09:50:53.010576 19220 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.011332 19275 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.012372 19215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.012491 19215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.012526 19227 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260812 09:50:53.012382 19220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.012794 19220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.013988 19423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.014137 19423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:53.015566 19424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.015890 19227 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:53.016048 19227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:53.016089 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "9faa44432c6949fcab94cd7263011e63"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "d04a1491e5a0d5a77b1873cedcca9762"
server_key_iv: "8431dfca9151d65267d67515de4a3db7"
server_key_version: "encryptionkey@0"
I20260812 09:50:53.018235 19227 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:53.020586 19227 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 09:50:53.020720 19227 log.cc:1196] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 09:50:53.021004 19227 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Deleting consensus metadata
I20260812 09:50:53.021260 19227 master_runner.cc:315] Copying system tablet from 127.11.118.190:38609
I20260812 09:50:53.022745 19227 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: tablet copy: Beginning tablet copy session from remote peer at address 127.11.118.190:38609
I20260812 09:50:53.032138 19431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.023412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:43764)
0812 09:50:53.023764 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.023777 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.023926 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.024200 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.024203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.024443 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.024557 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.024564 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.025373 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.025378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.026002 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.026011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.026511 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.026515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.026613 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.027759 (+ 1146us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.027773 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.028193 (+ 420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.030283 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.030290 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.030294 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.030520 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.030838 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.030842 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.030844 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.030940 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.031517 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.031521 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.031634 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.031750 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.031935 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":94,"threads_started":1}
I20260812 09:50:53.032124 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.023479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43764 (local address 127.11.118.190:38609)
0812 09:50:53.023620 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.023626 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.023871 (+ 245us) server_negotiation.cc:407] Connection header received
0812 09:50:53.024029 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.024032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.024086 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.024179 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.024688 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.025249 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.026132 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.026381 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.026502 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.028390 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.028397 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.028401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.028434 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.030144 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.030640 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.030643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.030649 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.030734 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.031180 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.031184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.031185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.031407 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.031527 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.031807 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.031934 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:50:53.033057 18612 tablet_copy_service.cc:140] P 12fa70469c9d474490ca6f12a0f1a3bd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9faa44432c6949fcab94cd7263011e63 ({username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:43764)
I20260812 09:50:53.033190 18612 tablet_copy_service.cc:161] P 12fa70469c9d474490ca6f12a0f1a3bd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9faa44432c6949fcab94cd7263011e63 at {username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:43764: session id = 9faa44432c6949fcab94cd7263011e63-00000000000000000000000000000000
I20260812 09:50:53.034118 18612 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 09:50:53.035650 19227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 09:50:53.038056 19227 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: tablet copy: Starting download of 0 data blocks...
I20260812 09:50:53.038301 19227 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: tablet copy: Starting download of 1 WAL segments...
I20260812 09:50:53.040076 19227 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 09:50:53.041908 18612 tablet_copy_service.cc:342] P 12fa70469c9d474490ca6f12a0f1a3bd: Request end of tablet copy session 9faa44432c6949fcab94cd7263011e63-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:43764
I20260812 09:50:53.042029 18612 tablet_copy_service.cc:433] P 12fa70469c9d474490ca6f12a0f1a3bd: ending tablet copy session 9faa44432c6949fcab94cd7263011e63-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9faa44432c6949fcab94cd7263011e63
I20260812 09:50:53.050742 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:53.053439 19432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:53.056239 19433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.056898 19227 server_base.cc:1034] running on GCE node
W20260812 09:50:53.063225 19435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.063680 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:53.064091 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:53.065303 19227 hybrid_clock.cc:648] HybridClock initialized: now 1786528253065287 us; error 40 us; skew 500 ppm
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:53.067550 19227 init.cc:377] Logged in from keytab as oryx/127.11.118.188@KRBTEST.COM (short username oryx)
I20260812 09:50:53.068187 19227 webserver.cc:460] Webserver started at http://127.11.118.188:43045/ using document root <none> and password file <none>
I20260812 09:50:53.068409 19227 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:53.068473 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:53.069741 19227 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:53.070811 19443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.071165 19227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:53.071270 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "9faa44432c6949fcab94cd7263011e63"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "d04a1491e5a0d5a77b1873cedcca9762"
server_key_iv: "8431dfca9151d65267d67515de4a3db7"
server_key_version: "encryptionkey@0"
I20260812 09:50:53.071393 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:53.086305 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:53.088918 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:53.094688 19227 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.188:34409
I20260812 09:50:53.094730 19503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.188:34409 every 8 connection(s)
I20260812 09:50:53.095883 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
I20260812 09:50:53.097476 19504 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:50:53.098393 19504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Bootstrap starting.
I20260812 09:50:53.108513 19504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:50:53.108884 19504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Bootstrap complete.
I20260812 09:50:53.109480 19504 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } }
I20260812 09:50:53.109635 19504 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9faa44432c6949fcab94cd7263011e63, State: Initialized, Role: LEARNER
I20260812 09:50:53.109759 19504 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } }
I20260812 09:50:53.110179 19507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.110358 19504 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:53.110368 19507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: LEARNER
I20260812 09:50:53.113662 19518 catalog_manager.cc:1259] Loaded cluster ID: 88e034a1418d4819adca65b9e222476d
I20260812 09:50:53.113826 19518 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: loading cluster ID for follower catalog manager: success
I20260812 09:50:53.115973 19518 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: acquiring CA information for follower catalog manager: success
I20260812 09:50:53.117234 19518 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 09:50:53.122068 19420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:53.122471 19420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:53.122542 19420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:53.129395 19420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:53.129505 19420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:53.129601 19420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:53.138036 19420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:38671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=33697
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:53.139461 19420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:53.140793 19420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:53.151810 19526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.151994 19420 server_base.cc:1034] running on GCE node
W20260812 09:50:53.151810 19525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:53.151839 19528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.152827 19420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:53.153606 19420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:53.154819 19420 hybrid_clock.cc:648] HybridClock initialized: now 1786528253154784 us; error 51 us; skew 500 ppm
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:53.158250 19420 init.cc:377] Logged in from keytab as oryx/127.11.118.129@KRBTEST.COM (short username oryx)
I20260812 09:50:53.159544 19420 webserver.cc:460] Webserver started at http://127.11.118.129:33697/ using document root <none> and password file <none>
I20260812 09:50:53.160173 19420 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:53.160305 19420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:53.164808 19420 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:50:53.167320 19536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.168991 19420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:53.169171 19420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "f09a0d042e776dd7972a29f9196c783c"
server_key_iv: "eadf7e91d8ad84d3aea5a36ca3b4a824"
server_key_version: "encryptionkey@0"
I20260812 09:50:53.169822 19420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:53.185156 19420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:53.189401 19420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:53.189585 19420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:53.190356 19420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:53.191640 19420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:53.191721 19420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.191790 19420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:53.191815 19420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.202370 19420 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38671
I20260812 09:50:53.202459 19666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38671 every 8 connection(s)
I20260812 09:50:53.203585 19420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:53.206225 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 19420
I20260812 09:50:53.206491 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18807
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
I20260812 09:50:53.228348 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.205582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:35791 (local address 127.11.118.190:38609)
0812 09:50:53.205750 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.205754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.208274 (+ 2520us) server_negotiation.cc:407] Connection header received
0812 09:50:53.210086 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.210090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.210157 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.210213 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.212467 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213245 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.215754 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.216092 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.216176 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.224171 (+ 7995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.224176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.224179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.224215 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.225975 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.226735 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.226742 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.226744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.226837 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.227215 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.227221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.227226 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.227476 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.227568 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.227997 (+ 429us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.228136 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:50:53.229135 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.208870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:50955 (local address 127.11.118.189:42445)
0812 09:50:53.209010 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.209015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.209629 (+ 614us) server_negotiation.cc:407] Connection header received
0812 09:50:53.210101 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.210108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.210193 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.210296 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.212104 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213257 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.215536 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.216069 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.216193 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.221287 (+ 5094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.221294 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.221299 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.221334 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.223257 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.224574 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.224579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.224582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.224691 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.225206 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.225210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.225213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.225510 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.225605 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.228848 (+ 3243us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.228989 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:50:53.229359 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.208966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:51771 (local address 127.11.118.188:34409)
0812 09:50:53.209346 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.209351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.209368 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:53.210165 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.210168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.210224 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.210762 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.212032 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213219 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.219906 (+ 6687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.220334 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.223219 (+ 2885us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.223377 (+ 158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.223381 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.223387 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.223409 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.226854 (+ 3445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.227394 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.227397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.227398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.227485 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.227899 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.227903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.227907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.228142 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.228243 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.228918 (+ 675us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.229095 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":233,"threads_started":1}
I20260812 09:50:53.230191 19674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.208980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.11.118.129:50955)
0812 09:50:53.209509 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.209521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.209825 (+ 304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.210593 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.210599 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.211332 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.211858 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.211879 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213862 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.213868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.215339 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.215356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.216435 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.216443 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.216723 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.217670 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.217694 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.221074 (+ 3380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.223502 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.223509 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.223529 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.223971 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.224831 (+ 860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.224836 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.224840 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.225075 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.225686 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.225694 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.226088 (+ 394us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.229334 (+ 3246us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.229577 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":67,"thread_start_us":226,"threads_started":1}
I20260812 09:50:53.230475 19672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.207815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.11.118.129:51771)
0812 09:50:53.208561 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.208577 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.209808 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.210562 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.210572 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.211268 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.211853 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.211875 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213414 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.213417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.214584 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.214596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.220545 (+ 5949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.220551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.220654 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.221329 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.221344 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.223031 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.227006 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.227009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.227011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.227263 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.227616 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.227623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.227628 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.227749 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.228262 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.228268 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.228398 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.228543 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.229010 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":46,"thread_start_us":552,"threads_started":1}
I20260812 09:50:53.231957 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.206019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:35791)
0812 09:50:53.208102 (+ 2083us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.208150 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.209808 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.210562 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.210572 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.212173 (+ 1601us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.212285 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.212292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.213414 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.213417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.215588 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.215600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.216428 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.216433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.216710 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.217627 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.217666 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.220622 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.226333 (+ 5711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.226336 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.226338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.226599 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.226984 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.226991 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.226995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.227094 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.227635 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.227638 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.227753 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.228562 (+ 809us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.231812 (+ 3250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1875,"mutex_wait_us":84,"spinlock_wait_cycles":16640,"thread_start_us":782,"threads_started":1}
I20260812 09:50:53.232892 19667 heartbeater.cc:347] Connected to a master server at 127.11.118.188:34409
I20260812 09:50:53.232892 19669 heartbeater.cc:347] Connected to a master server at 127.11.118.189:42445
I20260812 09:50:53.233206 19667 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.233206 19669 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.233937 19669 heartbeater.cc:511] Master 127.11.118.189:42445 requested a full tablet report, sending...
I20260812 09:50:53.233951 19667 heartbeater.cc:511] Master 127.11.118.188:34409 requested a full tablet report, sending...
I20260812 09:50:53.235838 19455 ts_manager.cc:194] Registered new tserver with Master: 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:53.236474 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:45939
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:38609
--webserver_port=43305
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:50:53.236985 19264 ts_manager.cc:194] Registered new tserver with Master: 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:53.237856 19105 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:53.238528 19668 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:53.238662 19668 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.238919 19668 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:53.239965 18590 ts_manager.cc:194] Re-registered known tserver with Master: 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:53.240527 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:35791
W20260812 09:50:53.362692 19675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:53.363085 19675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:53.363140 19675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:53.368873 19675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:53.368970 19675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:53.369063 19675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:53.378392 19675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:45939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=43305
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:53.379932 19675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:53.381060 19675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:53.392562 19681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:53.392561 19680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:53.392555 19684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.392647 19675 server_base.cc:1034] running on GCE node
I20260812 09:50:53.393395 19675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:53.394176 19675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:53.395411 19675 hybrid_clock.cc:648] HybridClock initialized: now 1786528253395394 us; error 34 us; skew 500 ppm
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:53.398856 19675 init.cc:377] Logged in from keytab as oryx/127.11.118.130@KRBTEST.COM (short username oryx)
I20260812 09:50:53.399936 19675 webserver.cc:460] Webserver started at http://127.11.118.130:43305/ using document root <none> and password file <none>
I20260812 09:50:53.400583 19675 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:53.400712 19675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:53.405133 19675 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:50:53.407516 19691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.409052 19675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:53.409231 19675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "17b41e879cea4ab08e5c216541a67684"
format_stamp: "Formatted at 2026-08-12 09:50:51 on dist-test-slave-2w3w"
server_key: "2789c5f0858a1f7a0856fde9d4b2a293"
server_key_iv: "b329b62785a5ae8aa39fb76809f9b0ad"
server_key_version: "encryptionkey@0"
I20260812 09:50:53.409868 19675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:53.429638 19675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:53.433557 19675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:53.433805 19675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:53.434475 19675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:53.435541 19675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:53.435621 19675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.435683 19675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:53.435714 19675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.445907 19675 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45939
I20260812 09:50:53.445936 19822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45939 every 8 connection(s)
I20260812 09:50:53.447135 19675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:53.456950 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 19675
I20260812 09:50:53.457161 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18955
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
I20260812 09:50:53.468014 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.449205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:60631 (local address 127.11.118.190:38609)
0812 09:50:53.449349 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.449353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.450650 (+ 1297us) server_negotiation.cc:407] Connection header received
0812 09:50:53.452005 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.452009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.452075 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.452136 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.453843 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.454416 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456359 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456703 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456821 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.462885 (+ 6064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.462889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.462895 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.462932 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.464901 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.465817 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.465820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.465822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.465907 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.466392 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.466396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.466398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.466636 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.466742 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.467602 (+ 860us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.467842 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:53.469128 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.451138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:53269 (local address 127.11.118.188:34409)
0812 09:50:53.451290 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.451295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.451462 (+ 167us) server_negotiation.cc:407] Connection header received
0812 09:50:53.451949 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.451961 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.452026 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.452126 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.453860 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.454685 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456098 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456436 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456538 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.461488 (+ 4950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.461495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.461498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.461535 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.465131 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.465802 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.465806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.465808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.465907 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.466392 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.466396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.466398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.466636 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.466736 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.468804 (+ 2068us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.468971 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 09:50:53.469290 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.449516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:60631)
0812 09:50:53.450465 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.450515 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.451717 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.452353 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.452363 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.452956 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.453671 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.453687 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.454583 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.454587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.456192 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.456203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456964 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.457843 (+ 875us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.458393 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.458412 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.462678 (+ 4266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.465074 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.465084 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.465106 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.465671 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.466020 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.466022 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.466024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.466271 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.466802 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.466810 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.467284 (+ 474us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.468203 (+ 919us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.468502 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"mutex_wait_us":251,"spinlock_wait_cycles":13824,"thread_start_us":575,"threads_started":1}
I20260812 09:50:53.469364 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.451011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.11.118.130:53269)
0812 09:50:53.451367 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.451383 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.451729 (+ 346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.452352 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.452360 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.452958 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.453684 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.453692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.454822 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.454825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.455909 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.455921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456732 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.456959 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.458594 (+ 1635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.458609 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.461197 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.465278 (+ 4081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.465282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.465283 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.465670 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.466018 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.466021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.466023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.466271 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.466802 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.466810 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.467306 (+ 496us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.467516 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.467905 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":521,"spinlock_wait_cycles":47616,"thread_start_us":124,"threads_started":1}
I20260812 09:50:53.469478 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.451563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:51745 (local address 127.11.118.189:42445)
0812 09:50:53.451696 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.451700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.451756 (+ 56us) server_negotiation.cc:407] Connection header received
0812 09:50:53.452270 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.452275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.452328 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.452417 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.453859 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.454684 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456351 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456648 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456760 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.462395 (+ 5635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.462403 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.462409 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.462686 (+ 277us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.465087 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.467556 (+ 2469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.467563 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.467567 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.467678 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.468043 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.468050 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.468055 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.468341 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.468447 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.469160 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.469305 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:50:53.469641 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:43495
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:38609
--webserver_port=44869
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:50:53.470629 19824 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:53.470906 19824 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.471170 19830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.451446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.11.118.130:51745)
0812 09:50:53.451679 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.451692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.451790 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.452456 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.452458 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.452958 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.453682 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.453692 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.455021 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.455024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.456192 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.456203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.456914 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.456918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.457106 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.458328 (+ 1222us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.458369 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.462220 (+ 3851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.465233 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.465239 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.465245 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.466997 (+ 1752us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.467800 (+ 803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.467805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.467810 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.467925 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.468812 (+ 887us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.468818 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.468949 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.470522 (+ 1573us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.470734 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":285,"spinlock_wait_cycles":3968,"thread_start_us":91,"threads_started":1}
I20260812 09:50:53.471805 19824 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:53.472249 19823 heartbeater.cc:347] Connected to a master server at 127.11.118.188:34409
I20260812 09:50:53.472373 19823 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.472539 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.457695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:44024)
0812 09:50:53.457836 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.457851 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.457934 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.460721 (+ 2787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.460727 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.460755 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.460911 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.460921 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.465845 (+ 4924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.465852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.467404 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.467420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.472076 (+ 4656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.472080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.472200 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.472230 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.472310 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.472403 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 09:50:53.472608 19823 heartbeater.cc:511] Master 127.11.118.188:34409 requested a full tablet report, sending...
I20260812 09:50:53.472882 19826 heartbeater.cc:347] Connected to a master server at 127.11.118.189:42445
I20260812 09:50:53.472977 19826 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.473080 18590 ts_manager.cc:194] Re-registered known tserver with Master: 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
I20260812 09:50:53.473155 19826 heartbeater.cc:511] Master 127.11.118.189:42445 requested a full tablet report, sending...
I20260812 09:50:53.473515 19831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.460017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.11.118.188:34409)
0812 09:50:53.460310 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.460317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.460337 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:50:53.460411 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.460417 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.460498 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.461032 (+ 534us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.461208 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.465697 (+ 4489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.471072 (+ 5375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.471889 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.472101 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.473248 (+ 1147us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.473291 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.473386 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":86,"threads_started":1}
I20260812 09:50:53.473542 19455 ts_manager.cc:194] Registered new tserver with Master: 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
I20260812 09:50:53.473838 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:60631
I20260812 09:50:53.474429 19473 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 09:50:53.474856 19507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12fa70469c9d474490ca6f12a0f1a3bd. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.475024 19507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: LEARNER
I20260812 09:50:53.475028 19264 ts_manager.cc:194] Registered new tserver with Master: 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
W20260812 09:50:53.595348 19832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:53.595719 19832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:53.595814 19832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:53.600697 19832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:53.600842 19832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:53.600942 19832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:53.607044 19832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:43495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=44869
--tserver_master_addrs=127.11.118.190:38609,127.11.118.189:42445,127.11.118.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:53.608325 19832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:53.609503 19832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:53.621250 19843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.621328 19832 server_base.cc:1034] running on GCE node
W20260812 09:50:53.621261 19841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:53.621268 19840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:53.621893 19832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:53.622587 19832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:53.623829 19832 hybrid_clock.cc:648] HybridClock initialized: now 1786528253623784 us; error 68 us; skew 500 ppm
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:53.627123 19832 init.cc:377] Logged in from keytab as oryx/127.11.118.131@KRBTEST.COM (short username oryx)
I20260812 09:50:53.628191 19832 webserver.cc:460] Webserver started at http://127.11.118.131:44869/ using document root <none> and password file <none>
I20260812 09:50:53.628855 19832 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:53.628991 19832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:53.633940 19832 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260812 09:50:53.636688 19854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.638391 19832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:53.638618 19832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "37fc0c005b7c4a219683d83706475666"
format_stamp: "Formatted at 2026-08-12 09:50:52 on dist-test-slave-2w3w"
server_key: "a34767bde06f80f10ef0b392b6abc789"
server_key_iv: "f575c4a0c1a40e8700ab0dbafd64ab04"
server_key_version: "encryptionkey@0"
I20260812 09:50:53.639431 19832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:53.677035 19832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:53.681046 19832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:53.681283 19832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:53.681960 19832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:50:53.682927 19832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:53.683039 19832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.683105 19832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:53.683154 19832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:53.694022 19832 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:43495
I20260812 09:50:53.694132 19982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:43495 every 8 connection(s)
I20260812 09:50:53.695364 19832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:53.701973 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 19832
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.189@KRBTEST.COM
Aug 12 09:50:53 dist-test-slave-2w3w krb5kdc[18541](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528253, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.188@KRBTEST.COM
I20260812 09:50:53.715636 18632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.699716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:34083 (local address 127.11.118.190:38609)
0812 09:50:53.699919 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.699924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.700028 (+ 104us) server_negotiation.cc:407] Connection header received
0812 09:50:53.700547 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.700553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.700617 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.700705 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.702665 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703486 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.705323 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.705676 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.705788 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.709381 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.709385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.709388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.709421 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.711831 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.713243 (+ 1412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.713247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.713250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.713345 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.713698 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.713706 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.713710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.713999 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.714110 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.715281 (+ 1171us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.715432 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:50:53.716804 19987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.697839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.11.118.131:38473)
0812 09:50:53.698868 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.698925 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.700299 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.700901 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.700906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.701500 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.702452 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.702476 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703698 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.703701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.705981 (+ 2280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.705992 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.706614 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.707382 (+ 765us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.707865 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.707879 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.709504 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.712028 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.712037 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.712057 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.712588 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.712927 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.712930 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.712932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.713604 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.714173 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.714185 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.714671 (+ 486us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.714941 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.715446 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"mutex_wait_us":1260,"spinlock_wait_cycles":34432,"thread_start_us":608,"threads_started":1}
I20260812 09:50:53.717768 19398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.697403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:38473 (local address 127.11.118.189:42445)
0812 09:50:53.697560 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.697564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.699229 (+ 1665us) server_negotiation.cc:407] Connection header received
0812 09:50:53.700614 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.700617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.700684 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.700741 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.702664 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703557 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706104 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.706476 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706579 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.709657 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.709660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.709663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.709691 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.711753 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.712708 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.712713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.712715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.712808 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.713733 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.713736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.713738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.714000 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.714107 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.717441 (+ 3334us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.717582 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:50:53.718801 19831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.700186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:56053 (local address 127.11.118.188:34409)
0812 09:50:53.700316 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.700321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.700341 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:50:53.700862 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.700866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.700919 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.701003 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.702664 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703539 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706112 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.706456 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706550 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.712759 (+ 6209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.712763 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.712766 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.712797 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.714838 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.716234 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.716238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.716240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.716358 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.717764 (+ 1406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.717768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.717770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.718022 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.718101 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.718501 (+ 400us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.718661 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:53.718943 19985 heartbeater.cc:347] Connected to a master server at 127.11.118.189:42445
I20260812 09:50:53.719231 19985 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.719272 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.705107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53490 (local address 127.11.118.189:42445)
0812 09:50:53.707720 (+ 2613us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.707727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.708107 (+ 380us) server_negotiation.cc:407] Connection header received
0812 09:50:53.708156 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.708159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.708209 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.708293 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.709343 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.710134 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.712272 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.712709 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.712787 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.714978 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.714984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.714987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.715011 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.716989 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.717538 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.717543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.717547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.717628 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.717986 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.717992 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.717995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.718217 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.718359 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.718989 (+ 630us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.719120 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2511,"thread_start_us":91,"threads_started":1}
I20260812 09:50:53.719391 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.700027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.11.118.131:56053)
0812 09:50:53.700276 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.700292 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.700377 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.701035 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.701038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.701474 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.702452 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.702476 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703698 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.703701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.705948 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.705961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.706739 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.706862 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.707392 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.707407 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.712584 (+ 5177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.715541 (+ 2957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.715545 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.715547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.715815 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.716487 (+ 672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.716489 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.716491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.716582 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.718189 (+ 1607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.718192 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.718306 (+ 114us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.719012 (+ 706us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.719180 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":1257,"spinlock_wait_cycles":16256,"thread_start_us":105,"threads_started":1}
I20260812 09:50:53.719832 19985 heartbeater.cc:511] Master 127.11.118.189:42445 requested a full tablet report, sending...
I20260812 09:50:53.720086 19983 heartbeater.cc:347] Connected to a master server at 127.11.118.188:34409
I20260812 09:50:53.720160 19983 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.720323 19983 heartbeater.cc:511] Master 127.11.118.188:34409 requested a full tablet report, sending...
I20260812 09:50:53.721103 19263 ts_manager.cc:194] Registered new tserver with Master: 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495)
I20260812 09:50:53.721103 19455 ts_manager.cc:194] Registered new tserver with Master: 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495)
I20260812 09:50:53.717442 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.699580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:34083)
0812 09:50:53.699934 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.699952 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.700301 (+ 349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.700868 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.700876 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.701474 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:53.702460 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.702479 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.703677 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.703681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.705167 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.705179 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.706180 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.706184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.706404 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.707121 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:53.707147 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:53.709176 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:53.712037 (+ 2861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.712041 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.712058 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.713132 (+ 1074us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.713467 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:53.713471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:53.713474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:53.713604 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:53.714200 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:53.714205 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:53.714669 (+ 464us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.714941 (+ 272us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.716297 (+ 1356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":1182,"spinlock_wait_cycles":24576,"thread_start_us":126,"threads_started":1}
I20260812 09:50:53.724512 19984 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38609
I20260812 09:50:53.724633 19984 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:53.724850 19984 heartbeater.cc:511] Master 127.11.118.190:38609 requested a full tablet report, sending...
I20260812 09:50:53.725591 18590 ts_manager.cc:194] Re-registered known tserver with Master: 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495)
I20260812 09:50:53.726349 18590 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:34083
I20260812 09:50:53.728812 19995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.704341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43770 (local address 127.11.118.190:38609)
0812 09:50:53.704643 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.704647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.705042 (+ 395us) server_negotiation.cc:407] Connection header received
0812 09:50:53.705235 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.705239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.705302 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.705365 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.707188 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.708021 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.712423 (+ 4402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.712811 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.712901 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.723150 (+ 10249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.723155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.723158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.723195 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.725278 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.727399 (+ 2121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.727404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.727408 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.727523 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.727846 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.727849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.727851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.728045 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.728197 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.728479 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.728619 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":105,"threads_started":1}
I20260812 09:50:53.732851 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.705799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.11.118.188:34409)
0812 09:50:53.705927 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.705932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.710585 (+ 4653us) server_negotiation.cc:407] Connection header received
0812 09:50:53.710700 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.710703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.710784 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.710867 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:53.724605 (+ 13738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.725511 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.726414 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.726777 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.726919 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.728569 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:53.728573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:53.728576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:53.728604 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:53.730608 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.731171 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.731176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.731183 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.731292 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:53.731593 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:53.731596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:53.731598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:53.731839 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:53.732146 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.732525 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.732662 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:53.732509 18590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:53.736505 18590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:53.739813 19217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: NON_VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: true } } }
I20260812 09:50:53.740027 19217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.745234 20004 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: attempting to promote NON_VOTER 9faa44432c6949fcab94cd7263011e63 to VOTER
I20260812 09:50:53.745734 20004 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } }
I20260812 09:50:53.747222 19473 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 LEARNER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 09:50:53.747598 19217 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 09:50:53.749718 20003 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9faa44432c6949fcab94cd7263011e63 (127.11.118.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.749908 19275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Refusing update from remote peer 12fa70469c9d474490ca6f12a0f1a3bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 09:50:53.750448 19217 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 09:50:53.750560 19473 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9faa44432c6949fcab94cd7263011e63 (127.11.118.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.751706 20003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.751819 20003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.751976 20003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.752061 20003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.751906 19274 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 9faa44432c6949fcab94cd7263011e63 (127.11.118.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.753477 19507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.753580 19507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:53.754508 20001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.754518 20014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:53.754652 20001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:53.754707 20014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:53.761411 19212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.756337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45939 (local address 127.0.0.1:51352)
0812 09:50:53.756504 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.756521 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.756608 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.757575 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.757578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.757599 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.757721 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.757732 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.759026 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.759031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.759817 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.759826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.760959 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.760962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.761066 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.761093 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.761145 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.761245 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":3}
I20260812 09:50:53.762115 20016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.756572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51352 (local address 127.11.118.130:45939)
0812 09:50:53.756994 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.757006 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.757029 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:50:53.757137 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.757143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.757407 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.757614 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.757872 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.758854 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.759973 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.760818 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.761695 (+ 877us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.761853 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.761908 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.761991 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":165,"threads_started":1}
I20260812 09:50:53.764133 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.756933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45334 (local address 127.11.118.131:43495)
0812 09:50:53.757297 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.757310 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.758020 (+ 710us) server_negotiation.cc:407] Connection header received
0812 09:50:53.758162 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.758167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.758423 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.758618 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.759207 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.760009 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.762340 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.763416 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.763574 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.763726 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.763853 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.763972 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":123,"threads_started":1}
I20260812 09:50:53.764163 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.756573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:43495 (local address 127.0.0.1:45334)
0812 09:50:53.757910 (+ 1337us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.757925 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.758042 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.758591 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.758594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.758614 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.758736 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.758744 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.760161 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.760167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.762082 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.762095 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.763573 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.763578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.763699 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.763727 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.763818 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.763899 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"thread_start_us":170,"threads_started":1}
I20260812 09:50:53.766167 19747 tablet_service.cc:1467] Processing CreateTablet for tablet ca12946316ff4e45b48b7ddf47442780 (DEFAULT_TABLE table=test-table [id=555fe70854ec447f83bb89ae82bc2415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:53.767163 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.757595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37364 (local address 127.11.118.129:38671)
0812 09:50:53.759059 (+ 1464us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.759207 (+ 148us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.760400 (+ 1193us) server_negotiation.cc:407] Connection header received
0812 09:50:53.760509 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.760514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.760749 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.760903 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.761324 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.762723 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.764786 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.765913 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.766058 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.766200 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.766863 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.767018 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":134,"threads_started":1}
I20260812 09:50:53.767401 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.757404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38671 (local address 127.0.0.1:37364)
0812 09:50:53.760138 (+ 2734us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.760153 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.760253 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.761064 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.761067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.761086 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.761169 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.761182 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.762887 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.762891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.764628 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.764637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.766281 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.766285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.766402 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.766429 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.766539 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.766633 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2658,"thread_start_us":108,"threads_started":1}
I20260812 09:50:53.767557 19747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12946316ff4e45b48b7ddf47442780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:53.767853 19906 tablet_service.cc:1467] Processing CreateTablet for tablet ca12946316ff4e45b48b7ddf47442780 (DEFAULT_TABLE table=test-table [id=555fe70854ec447f83bb89ae82bc2415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:53.769115 19906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12946316ff4e45b48b7ddf47442780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:53.771028 19589 tablet_service.cc:1467] Processing CreateTablet for tablet ca12946316ff4e45b48b7ddf47442780 (DEFAULT_TABLE table=test-table [id=555fe70854ec447f83bb89ae82bc2415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:53.772239 19589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca12946316ff4e45b48b7ddf47442780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:53.776813 20021 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Bootstrap starting.
I20260812 09:50:53.777733 20022 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Bootstrap starting.
I20260812 09:50:53.779213 20021 tablet_bootstrap.cc:654] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:53.779989 20022 tablet_bootstrap.cc:654] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:53.780714 20021 log.cc:824] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:53.780856 20022 log.cc:824] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:53.781773 20023 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Bootstrap starting.
I20260812 09:50:53.783079 20021 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: No bootstrap required, opened a new log
I20260812 09:50:53.783085 20022 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: No bootstrap required, opened a new log
I20260812 09:50:53.783304 20021 ts_tablet_manager.cc:1397] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:50:53.783304 20022 ts_tablet_manager.cc:1397] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:50:53.784154 20023 tablet_bootstrap.cc:654] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:53.785055 20023 log.cc:824] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:53.787473 20021 raft_consensus.cc:348] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.787794 20021 raft_consensus.cc:374] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:53.787725 20023 tablet_bootstrap.cc:492] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: No bootstrap required, opened a new log
I20260812 09:50:53.787853 20021 raft_consensus.cc:729] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37fc0c005b7c4a219683d83706475666, State: Initialized, Role: FOLLOWER
I20260812 09:50:53.788030 20023 ts_tablet_manager.cc:1397] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:50:53.787984 20022 raft_consensus.cc:348] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.788245 20022 raft_consensus.cc:374] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:53.788311 20022 raft_consensus.cc:729] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b41e879cea4ab08e5c216541a67684, State: Initialized, Role: FOLLOWER
I20260812 09:50:53.788637 20021 consensus_queue.cc:260] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.788754 20022 consensus_queue.cc:260] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.789832 20021 ts_tablet_manager.cc:1428] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:53.789835 20022 ts_tablet_manager.cc:1428] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:53.790084 19984 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:53.791872 19824 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:53.793233 20023 raft_consensus.cc:348] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.794557 20023 raft_consensus.cc:374] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:53.794646 20023 raft_consensus.cc:729] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68fd7e01cc934fa0b400cbf4d50949b8, State: Initialized, Role: FOLLOWER
I20260812 09:50:53.795295 20023 consensus_queue.cc:260] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.796758 20023 ts_tablet_manager.cc:1428] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260812 09:50:53.798133 19668 heartbeater.cc:503] Master 127.11.118.190:38609 was elected leader, sending a full tablet report...
I20260812 09:50:53.917202 20029 raft_consensus.cc:482] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:53.917549 20029 raft_consensus.cc:504] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.918846 20029 leader_election.cc:288] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495), 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:53.925287 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.919411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:43777 (local address 127.11.118.131:43495)
0812 09:50:53.919551 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.919557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.919577 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:50:53.919723 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.919728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.919783 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.919880 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.920412 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.921276 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.923569 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.924246 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.924400 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.924465 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.925033 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.925136 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:53.925287 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.919405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:35105 (local address 127.11.118.129:38671)
0812 09:50:53.919551 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.919557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.919575 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:53.919675 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.919679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.919737 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.919857 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:53.920412 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.921276 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.923569 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.924226 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.924407 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.924465 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.925033 (+ 568us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.925136 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:53.925287 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.919221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:43495 (local address 127.11.118.130:43777)
0812 09:50:53.919533 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.919548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.919612 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.919942 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.919950 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.919975 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.920259 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.920268 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.921453 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.921458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.923359 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.923377 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.924443 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.924447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.924658 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.924848 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.924951 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.925094 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":481}
I20260812 09:50:53.925295 19830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.919221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38671 (local address 127.11.118.130:35105)
0812 09:50:53.919339 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:53.919357 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:53.919462 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:53.919942 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:53.919950 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:53.919980 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:53.920228 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.920237 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.921453 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.921458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.923359 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:53.923377 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.924443 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.924447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:53.924655 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.924850 (+ 195us) client_negotiation.cc:769] Sending connection context
0812 09:50:53.924951 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 09:50:53.925094 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":617,"spinlock_wait_cycles":5888}
I20260812 09:50:53.926139 19927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12946316ff4e45b48b7ddf47442780" candidate_uuid: "17b41e879cea4ab08e5c216541a67684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37fc0c005b7c4a219683d83706475666" is_pre_election: true
I20260812 09:50:53.926139 19612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12946316ff4e45b48b7ddf47442780" candidate_uuid: "17b41e879cea4ab08e5c216541a67684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" is_pre_election: true
I20260812 09:50:53.926548 19927 raft_consensus.cc:2454] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b41e879cea4ab08e5c216541a67684 in term 0.
I20260812 09:50:53.926548 19612 raft_consensus.cc:2454] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17b41e879cea4ab08e5c216541a67684 in term 0.
I20260812 09:50:53.927318 19695 leader_election.cc:302] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 17b41e879cea4ab08e5c216541a67684, 37fc0c005b7c4a219683d83706475666, 68fd7e01cc934fa0b400cbf4d50949b8; no voters:
I20260812 09:50:53.927671 20029 raft_consensus.cc:2781] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:53.927776 20029 raft_consensus.cc:482] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:53.927822 20029 raft_consensus.cc:3037] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:53.928982 20029 raft_consensus.cc:504] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.929432 20029 leader_election.cc:288] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [CANDIDATE]: Term 1 election: Requested vote from peers 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495), 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671)
I20260812 09:50:53.929950 19927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12946316ff4e45b48b7ddf47442780" candidate_uuid: "17b41e879cea4ab08e5c216541a67684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37fc0c005b7c4a219683d83706475666"
I20260812 09:50:53.930017 19612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca12946316ff4e45b48b7ddf47442780" candidate_uuid: "17b41e879cea4ab08e5c216541a67684" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
I20260812 09:50:53.930130 19927 raft_consensus.cc:3037] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:53.930197 19612 raft_consensus.cc:3037] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:53.931444 19927 raft_consensus.cc:2454] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b41e879cea4ab08e5c216541a67684 in term 1.
I20260812 09:50:53.931454 19612 raft_consensus.cc:2454] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17b41e879cea4ab08e5c216541a67684 in term 1.
I20260812 09:50:53.931876 19695 leader_election.cc:302] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b41e879cea4ab08e5c216541a67684, 68fd7e01cc934fa0b400cbf4d50949b8; no voters:
I20260812 09:50:53.932097 20029 raft_consensus.cc:2781] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:53.932344 20029 raft_consensus.cc:686] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 1 LEADER]: Becoming Leader. State: Replica: 17b41e879cea4ab08e5c216541a67684, State: Running, Role: LEADER
I20260812 09:50:53.932701 20029 consensus_queue.cc:237] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } }
I20260812 09:50:53.936496 18589 catalog_manager.cc:5495] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17b41e879cea4ab08e5c216541a67684 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "17b41e879cea4ab08e5c216541a67684" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } health_report { overall_health: UNKNOWN } } }
W20260812 09:50:53.947396 19986 tablet.cc:2369] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:53.949465 19827 tablet.cc:2369] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:50:53.956015 19670 tablet.cc:2369] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:53.960345 20016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.956087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.11.118.130:45939)
0812 09:50:53.956253 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.956258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:53.956276 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:53.956434 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:53.956438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:53.956501 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:53.956630 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:53.956916 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.957482 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.958474 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:53.958725 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:53.958848 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:53.959279 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:53.959843 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:53.960004 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:53.960074 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 09:50:53.960149 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:50:53.967391 19927 raft_consensus.cc:1261] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Refusing update from remote peer 17b41e879cea4ab08e5c216541a67684: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:53.967391 19612 raft_consensus.cc:1261] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Refusing update from remote peer 17b41e879cea4ab08e5c216541a67684: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:53.968236 20029 consensus_queue.cc:1035] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:53.968564 20031 consensus_queue.cc:1035] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:53.983328 20035 mvcc.cc:205] Tried to move back new op lower bound from 7317619728241934336 to 7317619728111267840. Current Snapshot: MvccSnapshot[applied={T|T < 7317619728241934336}]
I20260812 09:50:53.987751 20036 mvcc.cc:205] Tried to move back new op lower bound from 7317619728241934336 to 7317619728111267840. Current Snapshot: MvccSnapshot[applied={T|T < 7317619728241934336 or (T in {7317619728241934336})}]
I20260812 09:50:53.989701 18590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:53.989921 18590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:53.996753 18590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 12fa70469c9d474490ca6f12a0f1a3bd: Sending DeleteTablet for 3 replicas of tablet ca12946316ff4e45b48b7ddf47442780
I20260812 09:50:53.998241 19747 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12946316ff4e45b48b7ddf47442780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:53 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:51352
I20260812 09:50:53.998453 19906 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12946316ff4e45b48b7ddf47442780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:53 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45334
I20260812 09:50:53.999907 20044 tablet_replica.cc:330] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: stopping tablet replica
I20260812 09:50:53.999928 19589 tablet_service.cc:1514] Processing DeleteTablet for tablet ca12946316ff4e45b48b7ddf47442780 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:53 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:37364
I20260812 09:50:54.000430 20044 raft_consensus.cc:2229] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:54.000838 20044 raft_consensus.cc:2258] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:54.001319 20046 tablet_replica.cc:330] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: stopping tablet replica
I20260812 09:50:54.001536 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 18555
I20260812 09:50:54.007133 20044 ts_tablet_manager.cc:1905] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:54.010660 20043 tablet_replica.cc:330] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: stopping tablet replica
I20260812 09:50:54.011047 20046 raft_consensus.cc:2229] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:54.011554 20043 raft_consensus.cc:2229] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:54.011602 20046 raft_consensus.cc:2258] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:54.012136 20044 ts_tablet_manager.cc:1918] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:54.012291 20044 log.cc:1196] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/ca12946316ff4e45b48b7ddf47442780
I20260812 09:50:54.012733 20044 ts_tablet_manager.cc:1939] T ca12946316ff4e45b48b7ddf47442780 P 37fc0c005b7c4a219683d83706475666: Deleting consensus metadata
I20260812 09:50:54.014127 20043 raft_consensus.cc:2258] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:54.016479 20046 ts_tablet_manager.cc:1905] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 09:50:54.017732 19858 connection.cc:535] server connection from 127.0.0.1:45334 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 09:50:54.020900 20046 ts_tablet_manager.cc:1918] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:54.021044 20046 log.cc:1196] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/ca12946316ff4e45b48b7ddf47442780
I20260812 09:50:54.021512 20046 ts_tablet_manager.cc:1939] T ca12946316ff4e45b48b7ddf47442780 P 68fd7e01cc934fa0b400cbf4d50949b8: Deleting consensus metadata
I20260812 09:50:54.021813 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.999382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53498 (local address 127.11.118.189:42445)
0812 09:50:53.999516 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.999522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:54.001351 (+ 1829us) server_negotiation.cc:407] Connection header received
0812 09:50:54.001604 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:54.001608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:54.001668 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:54.001777 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:54.006653 (+ 4876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.007569 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.008980 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.009392 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.009507 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:54.016082 (+ 6575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:54.016087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:54.016091 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:54.016134 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:54.018589 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.019787 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.019792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.019795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.019916 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.020317 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.020322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.020327 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.020618 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:54.020784 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:54.021360 (+ 576us) server_negotiation.cc:299] Negotiation successful
0812 09:50:54.021562 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:54.023074 20043 ts_tablet_manager.cc:1905] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 09:50:54.026124 19540 connection.cc:441] server connection from 127.0.0.1:37364 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37364 (request call id 1) could send its response
I20260812 09:50:54.026711 20043 ts_tablet_manager.cc:1918] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:54.026890 20043 log.cc:1196] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/ca12946316ff4e45b48b7ddf47442780
I20260812 09:50:54.027714 20043 ts_tablet_manager.cc:1939] T ca12946316ff4e45b48b7ddf47442780 P 17b41e879cea4ab08e5c216541a67684: Deleting consensus metadata
W20260812 09:50:54.029155 19695 connection.cc:441] server connection from 127.0.0.1:51352 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51352 (request call id 1) could send its response
I20260812 09:50:54.037421 19673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:53.999785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44040 (local address 127.11.118.188:34409)
0812 09:50:53.999930 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:53.999935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:54.023729 (+ 23794us) server_negotiation.cc:407] Connection header received
0812 09:50:54.023799 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:54.023802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:54.023869 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:54.023963 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:54.024972 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.025912 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.028117 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.028544 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.028636 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:54.031963 (+ 3327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:54.031968 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:54.031971 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:54.032004 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:54.034487 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.035783 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.035787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.035789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.035890 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.036237 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.036241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.036243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.036511 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:54.036641 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:54.037028 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 09:50:54.037206 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:50:54.038763 19831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:54.027195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.11.118.188:34409)
0812 09:50:54.027326 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:54.027331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:54.029459 (+ 2128us) server_negotiation.cc:407] Connection header received
0812 09:50:54.029639 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:54.029642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:54.029690 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:54.029741 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:54.030734 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.031544 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.032671 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.032933 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.033067 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:54.034577 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:54.034581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:54.034586 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:54.034619 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:54.036683 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.037295 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.037299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.037301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.037401 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.037754 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.037758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.037763 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.037971 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:54.038083 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:54.038480 (+ 397us) server_negotiation.cc:299] Negotiation successful
0812 09:50:54.038614 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:50:54.038784 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:54.026241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53504 (local address 127.11.118.189:42445)
0812 09:50:54.026370 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:54.026376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:54.028206 (+ 1830us) server_negotiation.cc:407] Connection header received
0812 09:50:54.028424 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:54.028427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:54.028486 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:54.028542 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:54.029632 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.030484 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.031681 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:54.032047 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:54.032127 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:54.034358 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:54.034363 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:54.034366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:54.034400 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:54.036650 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.037296 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.037299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.037301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.037392 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:54.037809 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:54.037814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:54.037815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:54.038031 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:54.038140 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:54.038480 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 09:50:54.038613 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 09:50:54.986627 20055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:54.986137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:34805)
0812 09:50:54.986422 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:54.986530 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":120,"threads_started":1}
W20260812 09:50:54.987160 19668 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:38609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:54.988668 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:54.987864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:48173)
0812 09:50:54.988190 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:54.988509 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":84,"threads_started":1}
W20260812 09:50:54.989035 19984 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:38609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:54.990778 20058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:54.990226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:40565)
0812 09:50:54.990577 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:54.990678 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":142,"threads_started":1}
W20260812 09:50:54.991099 19824 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:38609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.496793 20059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 12fa70469c9d474490ca6f12a0f1a3bd)
I20260812 09:50:55.497053 20059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } }
I20260812 09:50:55.497740 20060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 12fa70469c9d474490ca6f12a0f1a3bd)
I20260812 09:50:55.497972 20060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } }
I20260812 09:50:55.498317 20059 leader_election.cc:288] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609), 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189:42445)
I20260812 09:50:55.498981 20060 leader_election.cc:288] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609), 9faa44432c6949fcab94cd7263011e63 (127.11.118.188:34409)
I20260812 09:50:55.499032 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.498545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44306)
0812 09:50:55.498771 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.498884 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":73,"threads_started":1}
W20260812 09:50:55.499394 19448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.499554 20063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.499139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44314)
0812 09:50:55.499379 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.499452 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":60,"threads_started":1}
W20260812 09:50:55.499805 19250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.500440 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.500196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44324)
0812 09:50:55.500332 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.500380 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260812 09:50:55.500640 19448 leader_election.cc:334] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609): Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.500730 20066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.500502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44326)
0812 09:50:55.500595 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.500653 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 09:50:55.500837 19250 leader_election.cc:334] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609): Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.503379 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.498916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:42445 (local address 127.0.0.1:53512)
0812 09:50:55.499246 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.499261 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.499376 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.499907 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.499910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.499931 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.500052 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.500059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.501197 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.501203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.502044 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.502086 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.502858 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.502862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.503005 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.503036 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.503127 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.503216 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":104,"threads_started":1}
I20260812 09:50:55.503360 20064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.499331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53512 (local address 127.11.118.189:42445)
0812 09:50:55.499643 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.499650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.499665 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:55.499715 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.499721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.499777 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.500169 (+ 392us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.500279 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.501086 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.502211 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.502723 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.502858 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.502915 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.503146 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.503244 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":229,"thread_start_us":54,"threads_started":1}
I20260812 09:50:55.504030 19275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9faa44432c6949fcab94cd7263011e63" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" is_pre_election: true
I20260812 09:50:55.504281 19275 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9faa44432c6949fcab94cd7263011e63 in term 1.
I20260812 09:50:55.504400 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.500088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.11.118.188:34409)
0812 09:50:55.500406 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.500418 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.500435 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:55.500478 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.500481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.501038 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.501147 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.501393 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.501973 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.503298 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.503825 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.503967 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.504015 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.504205 (+ 190us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.504276 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":89,"threads_started":1}
I20260812 09:50:55.504441 20063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.499578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:34409 (local address 127.0.0.1:44056)
0812 09:50:55.499680 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.499693 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.499786 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.501157 (+ 1371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.501160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.501178 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.501278 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.501282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.502105 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.502109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.503135 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.503145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.503967 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.503971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.504072 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.504097 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.504190 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.504269 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":53,"thread_start_us":64,"threads_started":1}
I20260812 09:50:55.504703 19448 leader_election.cc:302] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a72fa501ade4c31bf02ac0f481f0ba9, 9faa44432c6949fcab94cd7263011e63; no voters: 12fa70469c9d474490ca6f12a0f1a3bd
I20260812 09:50:55.504944 20059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 09:50:55.505016 20059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 12fa70469c9d474490ca6f12a0f1a3bd)
I20260812 09:50:55.505069 20059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:50:55.504952 19473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9faa44432c6949fcab94cd7263011e63" is_pre_election: true
I20260812 09:50:55.506119 20059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } }
I20260812 09:50:55.506424 19473 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a72fa501ade4c31bf02ac0f481f0ba9 in current term 2: Already voted for candidate 9faa44432c6949fcab94cd7263011e63 in this term.
I20260812 09:50:55.506579 20059 leader_election.cc:288] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 election: Requested vote from peers 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609), 3a72fa501ade4c31bf02ac0f481f0ba9 (127.11.118.189:42445)
I20260812 09:50:55.506934 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.506703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44340)
0812 09:50:55.506798 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.506860 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 09:50:55.507201 19275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9faa44432c6949fcab94cd7263011e63" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9"
I20260812 09:50:55.507349 19275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:50:55.507580 19250 leader_election.cc:302] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a72fa501ade4c31bf02ac0f481f0ba9; no voters: 12fa70469c9d474490ca6f12a0f1a3bd, 9faa44432c6949fcab94cd7263011e63
I20260812 09:50:55.507959 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.507700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44346)
0812 09:50:55.507842 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.507897 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 09:50:55.508150 19448 leader_election.cc:334] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609): Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
I20260812 09:50:55.508641 19275 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9faa44432c6949fcab94cd7263011e63 in term 2.
I20260812 09:50:55.508762 20060 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:50:55.508998 19448 leader_election.cc:302] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a72fa501ade4c31bf02ac0f481f0ba9, 9faa44432c6949fcab94cd7263011e63; no voters: 12fa70469c9d474490ca6f12a0f1a3bd
I20260812 09:50:55.509171 20059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 09:50:55.509413 20059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [term 2 LEADER]: Becoming Leader. State: Replica: 9faa44432c6949fcab94cd7263011e63, State: Running, Role: LEADER
I20260812 09:50:55.509676 20059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } }
I20260812 09:50:55.511091 20069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9faa44432c6949fcab94cd7263011e63. Latest consensus state: current_term: 2 leader_uuid: "9faa44432c6949fcab94cd7263011e63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:55.511230 20069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:55.511612 20071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:55.514215 20071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:55.514655 20071 catalog_manager.cc:1259] Loaded cluster ID: 88e034a1418d4819adca65b9e222476d
I20260812 09:50:55.514703 20071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:55.515393 20071 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:55.515795 20071 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Loaded TSK: 0
I20260812 09:50:55.516525 20071 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:50:55.527657 19461 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:55.530861 19461 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:55.534284 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.533975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44358)
0812 09:50:55.534119 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.534194 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 09:50:55.534605 19275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [term 2 FOLLOWER]: Refusing update from remote peer 9faa44432c6949fcab94cd7263011e63: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260812 09:50:55.535183 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.534842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.0.0.1:44368)
0812 09:50:55.535080 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.535130 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260812 09:50:55.535221 20059 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 09:50:55.535418 19448 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 -> Peer 12fa70469c9d474490ca6f12a0f1a3bd (127.11.118.190:38609): Couldn't send request to peer 12fa70469c9d474490ca6f12a0f1a3bd. Status: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 09:50:55.536767 20060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9faa44432c6949fcab94cd7263011e63. Latest consensus state: current_term: 2 leader_uuid: "9faa44432c6949fcab94cd7263011e63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:55.536912 20060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:55.538147 20069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9faa44432c6949fcab94cd7263011e63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:55.538321 20069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:55.538527 20073 mvcc.cc:205] Tried to move back new op lower bound from 7317619734662598656 to 7317619734570397696. Current Snapshot: MvccSnapshot[applied={T|T < 7317619734662598656}]
I20260812 09:50:55.538728 20060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9faa44432c6949fcab94cd7263011e63" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "12fa70469c9d474490ca6f12a0f1a3bd" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38609 } } peers { permanent_uuid: "3a72fa501ade4c31bf02ac0f481f0ba9" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 42445 } attrs { promote: false } } peers { permanent_uuid: "9faa44432c6949fcab94cd7263011e63" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 34409 } attrs { promote: false } } }
I20260812 09:50:55.538931 20060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a72fa501ade4c31bf02ac0f481f0ba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:50:55.550629 20062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.545803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:43495 (local address 127.0.0.1:45338)
0812 09:50:55.545911 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.545926 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.546018 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.546924 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.546930 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.546952 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.547117 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.547124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548281 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.548284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.549244 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.549253 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.550185 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.550189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.550281 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.550308 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.550383 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.550467 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":24}
I20260812 09:50:55.550635 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.545932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.11.118.131:43495)
0812 09:50:55.546637 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.546643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.546663 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:50:55.546720 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.546724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.546778 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.547226 (+ 448us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.547346 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548164 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.549377 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.550045 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.550202 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.550274 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.550399 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.550478 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":114,"threads_started":1}
I20260812 09:50:55.551398 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.546083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38671 (local address 127.0.0.1:37374)
0812 09:50:55.546174 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.546191 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.546271 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.546898 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.546901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.546917 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.547085 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.547096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548780 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.548784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.549923 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.549930 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.551012 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.551015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.551108 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.551128 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.551203 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.551265 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":18,"spinlock_wait_cycles":768}
I20260812 09:50:55.551532 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.546356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37374 (local address 127.11.118.129:38671)
0812 09:50:55.546631 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.546636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.546653 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:55.546711 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.546718 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.546775 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.546892 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.547207 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548680 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.550098 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.550814 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.551042 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.551202 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.551258 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.551386 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":108,"threads_started":1}
I20260812 09:50:55.551298 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.546429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45939 (local address 127.0.0.1:51374)
0812 09:50:55.546681 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.546693 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.546775 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.547404 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.547407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.547428 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.547505 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.547511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548513 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.548518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.549779 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.549790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.550831 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.550835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.550934 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.550998 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.551066 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.551141 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":25,"thread_start_us":117,"threads_started":1}
I20260812 09:50:55.551731 19906 tablet_service.cc:1467] Processing CreateTablet for tablet a06db38617754efcb34ed71422cf66e2 (DEFAULT_TABLE table=test-table [id=7f09ffbd505b4972b00cc61c43cb9c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:55.552022 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.546820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51374 (local address 127.11.118.130:45939)
0812 09:50:55.547166 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.547172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.547188 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:50:55.547242 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.547245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.547289 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.547381 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.547636 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.548388 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.549929 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.550593 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.550716 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.550768 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.551768 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.551890 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":152,"threads_started":1}
I20260812 09:50:55.552065 19906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06db38617754efcb34ed71422cf66e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:55.552256 19589 tablet_service.cc:1467] Processing CreateTablet for tablet a06db38617754efcb34ed71422cf66e2 (DEFAULT_TABLE table=test-table [id=7f09ffbd505b4972b00cc61c43cb9c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:55.552517 19589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06db38617754efcb34ed71422cf66e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:55.554395 20082 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Bootstrap starting.
I20260812 09:50:55.554523 20083 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: Bootstrap starting.
I20260812 09:50:55.555086 19747 tablet_service.cc:1467] Processing CreateTablet for tablet a06db38617754efcb34ed71422cf66e2 (DEFAULT_TABLE table=test-table [id=7f09ffbd505b4972b00cc61c43cb9c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:55.555409 19747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06db38617754efcb34ed71422cf66e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:55.555490 20083 tablet_bootstrap.cc:654] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:55.555501 20082 tablet_bootstrap.cc:654] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:55.556689 20083 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: No bootstrap required, opened a new log
I20260812 09:50:55.556756 20083 ts_tablet_manager.cc:1397] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260812 09:50:55.557116 20083 raft_consensus.cc:348] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.557207 20083 raft_consensus.cc:374] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:55.557229 20083 raft_consensus.cc:729] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68fd7e01cc934fa0b400cbf4d50949b8, State: Initialized, Role: FOLLOWER
I20260812 09:50:55.557389 20083 consensus_queue.cc:260] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.557677 20086 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Bootstrap starting.
I20260812 09:50:55.557760 20083 ts_tablet_manager.cc:1428] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 09:50:55.558828 20082 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: No bootstrap required, opened a new log
I20260812 09:50:55.558924 20082 ts_tablet_manager.cc:1397] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 09:50:55.559551 20086 tablet_bootstrap.cc:654] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:55.559490 20082 raft_consensus.cc:348] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.559645 20082 raft_consensus.cc:374] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:55.559685 20082 raft_consensus.cc:729] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37fc0c005b7c4a219683d83706475666, State: Initialized, Role: FOLLOWER
I20260812 09:50:55.559870 20082 consensus_queue.cc:260] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.560199 20082 ts_tablet_manager.cc:1428] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:55.562264 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.560633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:43119)
0812 09:50:55.561782 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.562118 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1066,"thread_start_us":141,"threads_started":1}
I20260812 09:50:55.562760 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.558882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:43525)
0812 09:50:55.562543 (+ 3661us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.562617 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3596,"thread_start_us":138,"threads_started":1}
I20260812 09:50:55.563632 19983 heartbeater.cc:503] Master 127.11.118.188:34409 was elected leader, sending a full tablet report...
I20260812 09:50:55.563673 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.563369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:38069)
0812 09:50:55.563550 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.563601 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 09:50:55.563992 20086 tablet_bootstrap.cc:492] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: No bootstrap required, opened a new log
I20260812 09:50:55.564119 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.563892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:46509)
0812 09:50:55.563996 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.564054 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 09:50:55.564109 20086 ts_tablet_manager.cc:1397] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 09:50:55.564589 20086 raft_consensus.cc:348] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.564697 20086 raft_consensus.cc:374] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:55.564720 20086 raft_consensus.cc:729] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17b41e879cea4ab08e5c216541a67684, State: Initialized, Role: FOLLOWER
I20260812 09:50:55.564877 20086 consensus_queue.cc:260] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.565301 20086 ts_tablet_manager.cc:1428] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:55.566550 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.565948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:51519)
0812 09:50:55.566400 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.566464 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":110,"threads_started":1}
I20260812 09:50:55.567303 19823 heartbeater.cc:503] Master 127.11.118.188:34409 was elected leader, sending a full tablet report...
I20260812 09:50:55.567535 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.567025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:34267)
0812 09:50:55.567413 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.567468 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318}
I20260812 09:50:55.708755 20090 raft_consensus.cc:482] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:55.708922 20090 raft_consensus.cc:504] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.710346 20090 leader_election.cc:288] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671), 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
I20260812 09:50:55.715432 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.710647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45939 (local address 127.11.118.131:36183)
0812 09:50:55.710844 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.710874 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.711024 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.711410 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.711413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.711439 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.711627 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.711633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.712637 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.712639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.713934 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.713944 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.714879 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.714882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.715056 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.715097 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.715188 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.715282 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 09:50:55.715526 20081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.710880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:36183 (local address 127.11.118.130:45939)
0812 09:50:55.711080 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.711086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.711101 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:55.711162 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.711168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.711228 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.711326 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.711740 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.712524 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.714071 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.714692 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.714882 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.714944 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.715316 (+ 372us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.715397 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 09:50:55.715608 20079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.710762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:54113 (local address 127.11.118.129:38671)
0812 09:50:55.710905 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.710911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.711610 (+ 699us) server_negotiation.cc:407] Connection header received
0812 09:50:55.711726 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.711729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.711779 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.711859 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:55.712171 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.712837 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.714257 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.714930 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.715091 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.715145 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.715380 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.715460 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 09:50:55.715632 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.710657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38671 (local address 127.11.118.131:54113)
0812 09:50:55.711476 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.711490 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.711619 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.711958 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:55.711960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:55.711975 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:55.712058 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.712063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.712981 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.712984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.714131 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:55.714142 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.715116 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.715120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:55.715226 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.715250 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:50:55.715345 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 09:50:55.715423 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":447,"thread_start_us":154,"threads_started":1}
I20260812 09:50:55.716092 19769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06db38617754efcb34ed71422cf66e2" candidate_uuid: "37fc0c005b7c4a219683d83706475666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b41e879cea4ab08e5c216541a67684" is_pre_election: true
I20260812 09:50:55.716400 19769 raft_consensus.cc:2454] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37fc0c005b7c4a219683d83706475666 in term 0.
I20260812 09:50:55.716548 19612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06db38617754efcb34ed71422cf66e2" candidate_uuid: "37fc0c005b7c4a219683d83706475666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" is_pre_election: true
I20260812 09:50:55.716714 19612 raft_consensus.cc:2454] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37fc0c005b7c4a219683d83706475666 in term 0.
I20260812 09:50:55.716979 19855 leader_election.cc:302] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b41e879cea4ab08e5c216541a67684, 37fc0c005b7c4a219683d83706475666; no voters:
I20260812 09:50:55.717274 20090 raft_consensus.cc:2781] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:55.717358 20090 raft_consensus.cc:482] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:55.717415 20090 raft_consensus.cc:3037] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:55.718665 20090 raft_consensus.cc:504] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.719166 20090 leader_election.cc:288] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [CANDIDATE]: Term 1 election: Requested vote from peers 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671), 17b41e879cea4ab08e5c216541a67684 (127.11.118.130:45939)
I20260812 09:50:55.719568 19612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06db38617754efcb34ed71422cf66e2" candidate_uuid: "37fc0c005b7c4a219683d83706475666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68fd7e01cc934fa0b400cbf4d50949b8"
I20260812 09:50:55.719575 19769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06db38617754efcb34ed71422cf66e2" candidate_uuid: "37fc0c005b7c4a219683d83706475666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17b41e879cea4ab08e5c216541a67684"
I20260812 09:50:55.719717 19769 raft_consensus.cc:3037] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:55.719722 19612 raft_consensus.cc:3037] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:55.720887 19612 raft_consensus.cc:2454] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37fc0c005b7c4a219683d83706475666 in term 1.
I20260812 09:50:55.720995 19769 raft_consensus.cc:2454] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37fc0c005b7c4a219683d83706475666 in term 1.
I20260812 09:50:55.721273 19855 leader_election.cc:302] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17b41e879cea4ab08e5c216541a67684, 37fc0c005b7c4a219683d83706475666; no voters:
I20260812 09:50:55.721454 20090 raft_consensus.cc:2781] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:55.721777 20090 raft_consensus.cc:686] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 1 LEADER]: Becoming Leader. State: Replica: 37fc0c005b7c4a219683d83706475666, State: Running, Role: LEADER
I20260812 09:50:55.722087 20090 consensus_queue.cc:237] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } }
I20260812 09:50:55.727509 19455 catalog_manager.cc:5495] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37fc0c005b7c4a219683d83706475666 (127.11.118.131). New cstate: current_term: 1 leader_uuid: "37fc0c005b7c4a219683d83706475666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37fc0c005b7c4a219683d83706475666" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:55.728029 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.722285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:58577)
0812 09:50:55.727869 (+ 5584us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.727945 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5489}
I20260812 09:50:55.751166 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.746523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.11.118.131:43495)
0812 09:50:55.746728 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:55.746734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:55.746751 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:55.746925 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:55.746929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:55.747059 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:55.747184 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:55.747586 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.748191 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.749406 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:55.749761 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:55.749886 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:55.750164 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:55.750703 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:55.750800 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:55.750872 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 09:50:55.750930 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:50:55.762753 19612 raft_consensus.cc:1261] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Refusing update from remote peer 37fc0c005b7c4a219683d83706475666: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:55.763044 19769 raft_consensus.cc:1261] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Refusing update from remote peer 37fc0c005b7c4a219683d83706475666: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:55.763512 20095 consensus_queue.cc:1035] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68fd7e01cc934fa0b400cbf4d50949b8" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:55.764091 20095 consensus_queue.cc:1035] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17b41e879cea4ab08e5c216541a67684" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:55.764813 19667 heartbeater.cc:503] Master 127.11.118.188:34409 was elected leader, sending a full tablet report...
I20260812 09:50:55.765652 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.765294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:54911)
0812 09:50:55.765491 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.765556 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260812 09:50:55.769340 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.767011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:48007)
0812 09:50:55.769183 (+ 2172us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.769250 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2093}
I20260812 09:50:55.771081 20088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.770764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.129:51117)
0812 09:50:55.770918 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.771004 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 09:50:55.771734 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.768725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:45397)
0812 09:50:55.771589 (+ 2864us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.771656 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2791}
I20260812 09:50:55.772372 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.772156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.131:46767)
0812 09:50:55.772252 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.772303 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 09:50:55.772624 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.770867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38609 (local address 127.11.118.130:57587)
0812 09:50:55.772311 (+ 1444us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.772416 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:38609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1377}
I20260812 09:50:55.775097 20101 mvcc.cc:205] Tried to move back new op lower bound from 7317619735597821952 to 7317619735440863232. Current Snapshot: MvccSnapshot[applied={T|T < 7317619735597821952}]
I20260812 09:50:55.779654 19461 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:55.779881 19461 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:55.784226 19461 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9faa44432c6949fcab94cd7263011e63: Sending DeleteTablet for 3 replicas of tablet a06db38617754efcb34ed71422cf66e2
I20260812 09:50:55.784965 19906 tablet_service.cc:1514] Processing DeleteTablet for tablet a06db38617754efcb34ed71422cf66e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:55 UTC) from {username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:45338
I20260812 09:50:55.785044 19589 tablet_service.cc:1514] Processing DeleteTablet for tablet a06db38617754efcb34ed71422cf66e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:55 UTC) from {username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:37374
I20260812 09:50:55.785434 20109 tablet_replica.cc:330] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: stopping tablet replica
I20260812 09:50:55.785495 20110 tablet_replica.cc:330] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: stopping tablet replica
I20260812 09:50:55.785632 20110 raft_consensus.cc:2229] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:55.785663 20109 raft_consensus.cc:2229] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:55.785789 20110 raft_consensus.cc:2258] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:55.785769 19747 tablet_service.cc:1514] Processing DeleteTablet for tablet a06db38617754efcb34ed71422cf66e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:55 UTC) from {username='oryx', principal='oryx/127.11.118.188@KRBTEST.COM'} at 127.0.0.1:51374
I20260812 09:50:55.786183 20109 raft_consensus.cc:2258] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:55.786780 20110 ts_tablet_manager.cc:1905] T a06db38617754efcb34ed71422cf66e2 P 68fd7e01cc934fa0b400cbf4d50949b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:55.787122 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 19420
I20260812 09:50:55.787165 20109 ts_tablet_manager.cc:1905] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:55.795091 20109 ts_tablet_manager.cc:1918] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:55.795271 20111 tablet_replica.cc:330] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: stopping tablet replica
I20260812 09:50:55.795455 20111 raft_consensus.cc:2229] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:55.795332 20109 log.cc:1196] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/a06db38617754efcb34ed71422cf66e2
I20260812 09:50:55.795636 20111 raft_consensus.cc:2258] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:55.795954 20109 ts_tablet_manager.cc:1939] T a06db38617754efcb34ed71422cf66e2 P 37fc0c005b7c4a219683d83706475666: Deleting consensus metadata
I20260812 09:50:55.796823 20111 ts_tablet_manager.cc:1905] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:55.797106 19444 catalog_manager.cc:4841] TS 37fc0c005b7c4a219683d83706475666 (127.11.118.131:43495): tablet a06db38617754efcb34ed71422cf66e2 (table test-table [id=7f09ffbd505b4972b00cc61c43cb9c96]) successfully deleted
W20260812 09:50:55.799275 20080 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:55.798642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38671 (local address 127.0.0.1:37376)
0812 09:50:55.798791 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.798811 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:55.798916 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:55.799136 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38671: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 09:50:55.799520 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 19675
I20260812 09:50:55.799726 20111 ts_tablet_manager.cc:1918] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:55.799810 20111 log.cc:1196] T a06db38617754efcb34ed71422cf66e2 P 17b41e879cea4ab08e5c216541a67684: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/a06db38617754efcb34ed71422cf66e2
W20260812 09:50:55.801986 19448 catalog_manager.cc:4584] TS 68fd7e01cc934fa0b400cbf4d50949b8 (127.11.118.129:38671): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a06db38617754efcb34ed71422cf66e2: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38671: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 09:50:55.809693 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 19832
I20260812 09:50:55.809990 20080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:55.809581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45939 (local address 127.0.0.1:51384)
0812 09:50:55.809773 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:55.809855 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.130:45939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260812 09:50:55.819234 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 19110
I20260812 09:50:55.830529 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 19227
2026-08-12T09:50:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5985 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:55 dist-test-slave-2w3w krb5kdc[20115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:55 dist-test-slave-2w3w krb5kdc[20115](info): set up 2 sockets
Aug 12 09:50:55 dist-test-slave-2w3w krb5kdc[20115](info): commencing operation
krb5kdc: starting...
W20260812 09:50:56.970652 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:50:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:50:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab.
Entry for principal oryx/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab.
I20260812 09:50:57.120502 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39511
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab
--principal=oryx/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:39511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:57.241869 20131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:57.242194 20131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:57.242245 20131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:57.246596 20131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:50:57.246690 20131 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 09:50:57.246708 20131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:57.246727 20131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:57.246744 20131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:50:57.246760 20131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:50:57.252709 20131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:39511
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.190.keytab
--principal=oryx/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:57.254057 20131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:57.255282 20131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:57.264950 20138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:57.264964 20140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:57.265303 20131 server_base.cc:1034] running on GCE node
W20260812 09:50:57.265324 20137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:57.266197 20131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:57.267568 20131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:57.268795 20131 hybrid_clock.cc:648] HybridClock initialized: now 1786528257268760 us; error 56 us; skew 500 ppm
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:57.271997 20131 init.cc:377] Logged in from keytab as oryx/127.11.118.190@KRBTEST.COM (short username oryx)
I20260812 09:50:57.273011 20131 webserver.cc:460] Webserver started at http://127.11.118.190:40631/ using document root <none> and password file <none>
I20260812 09:50:57.273646 20131 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:57.273751 20131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:57.274009 20131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:57.276315 20131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "745e0d169dde473fa5d162d27a1797c1"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "6257a3a5a1aacc70338cd8129b81bce6"
server_key_iv: "f475f63e103ac0625d9a41266f35a08d"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.276983 20131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "745e0d169dde473fa5d162d27a1797c1"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "6257a3a5a1aacc70338cd8129b81bce6"
server_key_iv: "f475f63e103ac0625d9a41266f35a08d"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.281471 20131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260812 09:50:57.284396 20147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:57.285846 20131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:50:57.286046 20131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "745e0d169dde473fa5d162d27a1797c1"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "6257a3a5a1aacc70338cd8129b81bce6"
server_key_iv: "f475f63e103ac0625d9a41266f35a08d"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.286201 20131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:57.299086 20131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:57.302505 20131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:57.302762 20131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:57.312382 20131 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:39511
I20260812 09:50:57.312409 20218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:39511 every 8 connection(s)
I20260812 09:50:57.313503 20131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:50:57.316869 20219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:57.319650 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20131
I20260812 09:50:57.319799 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:50:57.320139 11738 external_mini_cluster.cc:1428] Setting key 487d898f8b80e65a19a6f238b1ab96cc
I20260812 09:50:57.324193 20219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Bootstrap starting.
I20260812 09:50:57.327075 20219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:57.327987 20219 log.cc:824] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:57.330632 20219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: No bootstrap required, opened a new log
I20260812 09:50:57.334544 20219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } }
I20260812 09:50:57.334856 20219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:57.334919 20219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 745e0d169dde473fa5d162d27a1797c1, State: Initialized, Role: FOLLOWER
I20260812 09:50:57.335525 20219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } }
I20260812 09:50:57.335712 20219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:50:57.335783 20219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:50:57.335891 20219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:57.336591 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.321724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43354 (local address 127.11.118.190:39511)
0812 09:50:57.322237 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:57.322255 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:57.322294 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:50:57.323071 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:57.323090 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:57.323448 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:57.323740 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:57.324847 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.325892 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.327251 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.327814 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.327976 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.331342 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:57.331348 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:57.331363 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:57.331392 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:57.333248 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.333771 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.333776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.333781 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.333943 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.334248 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.334253 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.334255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.334671 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:57.334931 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:57.335234 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 09:50:57.335542 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":184,"threads_started":1}
I20260812 09:50:57.336957 20219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } }
I20260812 09:50:57.337299 20219 leader_election.cc:302] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 745e0d169dde473fa5d162d27a1797c1; no voters:
I20260812 09:50:57.337683 20219 leader_election.cc:288] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:50:57.338083 20225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:57.338378 20225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [term 1 LEADER]: Becoming Leader. State: Replica: 745e0d169dde473fa5d162d27a1797c1, State: Running, Role: LEADER
I20260812 09:50:57.338703 20225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } }
I20260812 09:50:57.339044 20219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:50:57.340378 20224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 745e0d169dde473fa5d162d27a1797c1. Latest consensus state: current_term: 1 leader_uuid: "745e0d169dde473fa5d162d27a1797c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } } }
I20260812 09:50:57.340519 20224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [sys.catalog]: This master's current role is: LEADER
I20260812 09:50:57.340862 20226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "745e0d169dde473fa5d162d27a1797c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "745e0d169dde473fa5d162d27a1797c1" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39511 } } }
I20260812 09:50:57.340965 20226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1 [sys.catalog]: This master's current role is: LEADER
W20260812 09:50:57.343778 20239 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:50:57.343870 20239 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:50:57.343947 20235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:50:57.344862 20235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:50:57.350687 20235 catalog_manager.cc:1347] Generated new cluster ID: 8072c7d432204accaad52be429a3ecf7
I20260812 09:50:57.350783 20235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:50:57.357170 20235 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:50:57.358214 20235 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:50:57.366524 20235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Generated new TSK 0
I20260812 09:50:57.367427 20235 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
I20260812 09:50:57.403332 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39511
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:57.523778 20245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:57.524114 20245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:57.524164 20245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:57.528465 20245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:57.528553 20245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:57.528596 20245 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:57.528683 20245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:50:57.534574 20245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:39511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:57.535852 20245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:57.536932 20245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:57.547672 20250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:57.547674 20253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:57.547672 20251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:57.548084 20245 server_base.cc:1034] running on GCE node
I20260812 09:50:57.548534 20245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:57.549346 20245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:57.550592 20245 hybrid_clock.cc:648] HybridClock initialized: now 1786528257550571 us; error 33 us; skew 500 ppm
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:57.554116 20245 init.cc:377] Logged in from keytab as oryx/127.11.118.129@KRBTEST.COM (short username oryx)
I20260812 09:50:57.555342 20245 webserver.cc:460] Webserver started at http://127.11.118.129:33965/ using document root <none> and password file <none>
I20260812 09:50:57.555917 20245 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:57.555982 20245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:57.556162 20245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:57.558419 20245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "d49ebec8012c9e94f762b817e82cb885"
server_key_iv: "5ed7519f9cea9a75bf2fe89071f5f527"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.559058 20245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "d49ebec8012c9e94f762b817e82cb885"
server_key_iv: "5ed7519f9cea9a75bf2fe89071f5f527"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.563090 20245 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:50:57.565698 20260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:57.567562 20245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:57.567696 20245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "d49ebec8012c9e94f762b817e82cb885"
server_key_iv: "5ed7519f9cea9a75bf2fe89071f5f527"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.567812 20245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:57.608261 20245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:57.612068 20245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:57.612249 20245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:57.613747 20245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:57.613843 20245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:57.613922 20245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:57.613971 20245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:57.625741 20245 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:41319
I20260812 09:50:57.627084 20245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:50:57.627214 20388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:41319 every 8 connection(s)
I20260812 09:50:57.629455 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.615026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:40509 (local address 127.11.118.190:39511)
0812 09:50:57.615186 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:57.615189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:57.616269 (+ 1080us) server_negotiation.cc:407] Connection header received
0812 09:50:57.617476 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:57.617479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:57.617546 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:57.617641 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:57.619564 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.620194 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.621630 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.621892 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.622023 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.625114 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:57.625118 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:57.625120 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:57.625148 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:57.626932 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.627690 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.627694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.627696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.627808 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.628229 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.628232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.628234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.628454 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:57.628577 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:57.629114 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 09:50:57.629270 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 09:50:57.630299 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.615517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.129:40509)
0812 09:50:57.616085 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:57.616134 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:57.617223 (+ 1089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:57.617894 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:57.617906 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:57.618473 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:57.619373 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.619410 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.620358 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.620362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.621469 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.621481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.622089 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.622093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.622293 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.623087 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:57.623106 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:57.624904 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:57.627133 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.627141 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.627157 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.627558 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.627930 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.627933 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.627935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.628088 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.628576 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:57.628583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:57.628852 (+ 269us) client_negotiation.cc:769] Sending connection context
0812 09:50:57.629053 (+ 201us) client_negotiation.cc:240] Negotiation successful
0812 09:50:57.629431 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":156,"threads_started":1}
I20260812 09:50:57.631834 20389 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39511
I20260812 09:50:57.632001 20389 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:57.632329 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20245
I20260812 09:50:57.632512 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:50:57.632630 20389 heartbeater.cc:511] Master 127.11.118.190:39511 requested a full tablet report, sending...
I20260812 09:50:57.632933 11738 external_mini_cluster.cc:1428] Setting key feb494e22b06b4bedd48923dc20692af
I20260812 09:50:57.635030 20168 ts_manager.cc:194] Registered new tserver with Master: 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319)
I20260812 09:50:57.636222 20168 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:40509
I20260812 09:50:57.643847 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.634526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:32901 (local address 127.11.118.190:39511)
0812 09:50:57.634675 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:57.634680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:57.635161 (+ 481us) server_negotiation.cc:407] Connection header received
0812 09:50:57.635351 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:57.635369 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:57.635426 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:57.635483 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:57.636257 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.637125 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.638333 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.638672 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.638751 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.640363 (+ 1612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:57.640367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:57.640370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:57.640396 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:57.642044 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.642516 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.642521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.642523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.642614 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.642922 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.642925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.642927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.643163 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:57.643275 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:57.643552 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 09:50:57.643668 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:50:57.643862 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.634676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.129:32901)
0812 09:50:57.635069 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:57.635087 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:57.635241 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:57.635657 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:57.635662 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:57.635932 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:57.636105 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.636117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.637314 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.637317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.638188 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.638198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.638923 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.638926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.639056 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.639672 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:57.639687 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:57.640219 (+ 532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:57.642175 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.642179 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.642182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.642403 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.642713 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.642717 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.642719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.642813 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.643265 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:57.643268 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:57.643380 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 09:50:57.643493 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 09:50:57.643663 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":153,"threads_started":1}
WARNING: no policy specified for oryx/127.11.118.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
I20260812 09:50:57.667492 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39511
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:57.793514 20398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:57.793838 20398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:57.793887 20398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:57.799995 20398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:57.800093 20398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:57.800141 20398 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:57.800238 20398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:50:57.806478 20398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:39511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:57.807765 20398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:57.808902 20398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:57.819572 20406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:57.819574 20403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:57.819584 20404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:57.820051 20398 server_base.cc:1034] running on GCE node
I20260812 09:50:57.820559 20398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:57.821276 20398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:57.822497 20398 hybrid_clock.cc:648] HybridClock initialized: now 1786528257822482 us; error 30 us; skew 500 ppm
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:57.826012 20398 init.cc:377] Logged in from keytab as oryx/127.11.118.130@KRBTEST.COM (short username oryx)
I20260812 09:50:57.827178 20398 webserver.cc:460] Webserver started at http://127.11.118.130:40563/ using document root <none> and password file <none>
I20260812 09:50:57.827802 20398 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:57.827907 20398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:57.828194 20398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:57.830523 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "a5d7822eaec34a06adeb427c9e292828"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "50db2c7fffcde2b76910f92697383ab5"
server_key_iv: "c9f522974db0876fc2a7b9a7e33fac0a"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.831243 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "a5d7822eaec34a06adeb427c9e292828"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "50db2c7fffcde2b76910f92697383ab5"
server_key_iv: "c9f522974db0876fc2a7b9a7e33fac0a"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.836397 20398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260812 09:50:57.839510 20415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:57.841291 20398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:50:57.841447 20398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "a5d7822eaec34a06adeb427c9e292828"
format_stamp: "Formatted at 2026-08-12 09:50:57 on dist-test-slave-2w3w"
server_key: "50db2c7fffcde2b76910f92697383ab5"
server_key_iv: "c9f522974db0876fc2a7b9a7e33fac0a"
server_key_version: "encryptionkey@0"
I20260812 09:50:57.841617 20398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:57.859174 20398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:57.863732 20398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:57.863986 20398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:57.865808 20398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:57.865875 20398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:57.865928 20398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:57.865991 20398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:57 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:57.878558 20398 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:46243
I20260812 09:50:57.878628 20549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:46243 every 8 connection(s)
I20260812 09:50:57.879791 20398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:50:57.883737 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.866764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58497 (local address 127.11.118.190:39511)
0812 09:50:57.867026 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:57.867031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:57.868137 (+ 1106us) server_negotiation.cc:407] Connection header received
0812 09:50:57.869828 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:57.869833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:57.869969 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:57.870228 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:57.872207 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.873013 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.874825 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.875180 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.875316 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.878941 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:57.878945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:57.878948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:57.879028 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:57.881152 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.881886 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.881891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.881893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.881998 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.882392 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.882396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.882404 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.882630 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:57.882750 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:57.883408 (+ 658us) server_negotiation.cc:299] Negotiation successful
0812 09:50:57.883560 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 09:50:57.884658 20427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.867323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.130:58497)
0812 09:50:57.867875 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:57.867965 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:57.869442 (+ 1477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:57.870455 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:57.870465 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:57.871126 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:57.871975 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.872000 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.873194 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.873198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.874619 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.874634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.875380 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.875386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.875598 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.876470 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:57.876491 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:57.878678 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:57.881396 (+ 2718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.881403 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.881419 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.881748 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.882114 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.882118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.882120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.882281 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.882760 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:57.882770 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:57.883142 (+ 372us) client_negotiation.cc:769] Sending connection context
0812 09:50:57.883352 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 09:50:57.883715 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":120,"threads_started":1}
I20260812 09:50:57.886142 20550 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39511
I20260812 09:50:57.886319 20550 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:57.887010 20550 heartbeater.cc:511] Master 127.11.118.190:39511 requested a full tablet report, sending...
I20260812 09:50:57.887648 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20398
I20260812 09:50:57.887799 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:50:57.888141 11738 external_mini_cluster.cc:1428] Setting key 7af10655d5e7c89d433ad30cbd12109f
I20260812 09:50:57.888350 20169 ts_manager.cc:194] Registered new tserver with Master: a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243)
I20260812 09:50:57.889195 20169 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:58497
I20260812 09:50:57.898507 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.889368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:48791 (local address 127.11.118.190:39511)
0812 09:50:57.889532 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:57.889539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:57.889983 (+ 444us) server_negotiation.cc:407] Connection header received
0812 09:50:57.890349 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:57.890352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:57.890406 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:57.890499 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:57.891210 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.891823 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.892630 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.893016 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.893124 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.894713 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:57.894716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:57.894718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:57.894760 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:57.896444 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.897069 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.897072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.897073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.897161 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:57.897513 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:57.897515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:57.897516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:57.897758 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:57.897846 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:57.898223 (+ 377us) server_negotiation.cc:299] Negotiation successful
0812 09:50:57.898343 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 09:50:57.898594 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:57.888924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.130:48791)
0812 09:50:57.889887 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:57.889902 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:57.890048 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:57.890599 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:57.890603 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:57.890889 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:57.891077 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.891090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.891942 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.891945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.892503 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:57.892511 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:57.893185 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:57.893192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:57.893362 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:57.893978 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:57.893999 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:57.894540 (+ 541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:57.896589 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.896593 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.896603 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.896919 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.897281 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:57.897286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:57.897289 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:57.897399 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:57.897873 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:57.897878 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:57.898003 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 09:50:57.898134 (+ 131us) client_negotiation.cc:240] Negotiation successful
0812 09:50:57.898336 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":129,"threads_started":1}
WARNING: no policy specified for oryx/127.11.118.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
I20260812 09:50:57.928493 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39511
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:50:58.052666 20560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:50:58.052979 20560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:50:58.053030 20560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:50:58.057456 20560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:50:58.057534 20560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:50:58.057578 20560 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 09:50:58.057613 20560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:50:58.063334 20560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.118.190:39511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:50:58.064445 20560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:50:58.065500 20560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:50:58.076251 20566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:58.076258 20571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:50:58.076272 20565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:50:58.076647 20560 server_base.cc:1034] running on GCE node
I20260812 09:50:58.077179 20560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:50:58.077888 20560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:50:58.079051 20560 hybrid_clock.cc:648] HybridClock initialized: now 1786528258079009 us; error 49 us; skew 500 ppm
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:50:58.082285 20560 init.cc:377] Logged in from keytab as oryx/127.11.118.131@KRBTEST.COM (short username oryx)
I20260812 09:50:58.083392 20560 webserver.cc:460] Webserver started at http://127.11.118.131:36771/ using document root <none> and password file <none>
I20260812 09:50:58.084021 20560 fs_manager.cc:359] Metadata directory not provided
I20260812 09:50:58.084250 20560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:50:58.084549 20560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:50:58.087132 20560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "0ea530bb3779413692f1a024b9f4d84f"
format_stamp: "Formatted at 2026-08-12 09:50:58 on dist-test-slave-2w3w"
server_key: "b0974b2775898387749aa4aca0071cc2"
server_key_iv: "eaff9b227df1ff89327887a706054bad"
server_key_version: "encryptionkey@0"
I20260812 09:50:58.087858 20560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "0ea530bb3779413692f1a024b9f4d84f"
format_stamp: "Formatted at 2026-08-12 09:50:58 on dist-test-slave-2w3w"
server_key: "b0974b2775898387749aa4aca0071cc2"
server_key_iv: "eaff9b227df1ff89327887a706054bad"
server_key_version: "encryptionkey@0"
I20260812 09:50:58.092265 20560 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 09:50:58.095132 20579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:58.096513 20560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:50:58.096673 20560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "0ea530bb3779413692f1a024b9f4d84f"
format_stamp: "Formatted at 2026-08-12 09:50:58 on dist-test-slave-2w3w"
server_key: "b0974b2775898387749aa4aca0071cc2"
server_key_iv: "eaff9b227df1ff89327887a706054bad"
server_key_version: "encryptionkey@0"
I20260812 09:50:58.096807 20560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:50:58.122179 20560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:50:58.125981 20560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:50:58.126240 20560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:50:58.127909 20560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:50:58.127995 20560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:50:58.128072 20560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:50:58.128131 20560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:58.140991 20560 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:40567
I20260812 09:50:58.141070 20708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:40567 every 8 connection(s)
I20260812 09:50:58.142275 20560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:50:58.145500 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.128960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:49733 (local address 127.11.118.190:39511)
0812 09:50:58.129108 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.129112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.130252 (+ 1140us) server_negotiation.cc:407] Connection header received
0812 09:50:58.132051 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.132055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.132241 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.132358 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.134304 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.135040 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.136559 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.136814 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.136938 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.140703 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:58.140707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:58.140712 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:58.140753 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:58.142986 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.143694 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.143696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.143698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.143792 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.144151 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.144155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.144156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.144472 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:58.144557 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.145131 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.145326 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:50:58.146453 20590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.129537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.131:49733)
0812 09:50:58.130076 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.130124 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.131753 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.132637 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.132646 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.133227 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:58.134065 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.134091 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.135203 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.135206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.136409 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.136422 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.137003 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.137008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.137212 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.138043 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:58.138060 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:58.140413 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:58.143166 (+ 2753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.143172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.143189 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.143577 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.143893 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.143896 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.143897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.144043 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.144587 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:58.144593 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:58.144842 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.145069 (+ 227us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.145432 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":154,"threads_started":1}
I20260812 09:50:58.148236 20709 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39511
I20260812 09:50:58.148456 20709 heartbeater.cc:464] Registering TS with master...
I20260812 09:50:58.148612 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20560
I20260812 09:50:58.148780 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:50:58.149091 20709 heartbeater.cc:511] Master 127.11.118.190:39511 requested a full tablet report, sending...
I20260812 09:50:58.149295 11738 external_mini_cluster.cc:1428] Setting key 9abd610d5fa3a9ad5eb08e868a2d36e8
I20260812 09:50:58.150321 20169 ts_manager.cc:194] Registered new tserver with Master: 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:58.151176 20169 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:49733
I20260812 09:50:58.151635 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:50:58.159356 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.150918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.11.118.131:33887)
0812 09:50:58.151288 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.151306 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.151444 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.151834 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.151837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.152095 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:58.152223 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.152233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.153319 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.153322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.154041 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.154052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.154552 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.154556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.154661 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.155329 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:58.155341 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:58.155711 (+ 370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:58.157596 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.157600 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.157603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.157863 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.158171 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.158174 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.158176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.158271 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.158695 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:58.158699 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:58.158831 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.158939 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.159164 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":161,"threads_started":1}
I20260812 09:50:58.159642 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.151008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:33887 (local address 127.11.118.190:39511)
0812 09:50:58.151604 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.151615 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.151627 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:50:58.151657 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.151659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.151726 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.151811 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.152375 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.153143 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.154190 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.154421 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.154543 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.155877 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:58.155881 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:58.155884 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:58.155909 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:58.157462 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.157979 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.157983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.157985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.158070 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.158370 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.158374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.158376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.158588 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:58.158709 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.159101 (+ 392us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.159274 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514}
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 09:50:58.181071 20222 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:58.173860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43364 (local address 127.11.118.190:39511)
0812 09:50:58.174006 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.174010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.174024 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:50:58.174069 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.174071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.174111 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.174190 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.175106 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.175667 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.176622 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.176921 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.177027 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.180891 (+ 3864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43364: BlockingRecv error: recv got EOF from 127.0.0.1:43364 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:58.193357 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.183161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.11.118.190:39511)
0812 09:50:58.183363 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.183367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.183516 (+ 149us) server_negotiation.cc:407] Connection header received
0812 09:50:58.183600 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.183606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.183663 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.183779 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.184557 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.185121 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.186014 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.186233 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.186324 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.189293 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:58.189296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:58.189298 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:58.189334 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:58.191232 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.191867 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.191871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.191872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.191968 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.192325 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.192328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.192329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.192558 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:58.192685 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.193007 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.193122 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:50:58.196893 20169 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:58.200268 20169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:58.217083 20734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.210227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.0.0.1:45842)
0812 09:50:58.210566 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.210620 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.210752 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.212782 (+ 2030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.212785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.212803 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.212894 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.212901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.214010 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.214014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.215140 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.215152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.216241 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.216511 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.216596 (+ 85us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.216720 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.216911 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":147,"thread_start_us":78,"threads_started":1}
I20260812 09:50:58.217075 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.210403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.11.118.129:41319)
0812 09:50:58.210788 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.210798 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.211193 (+ 395us) server_negotiation.cc:407] Connection header received
0812 09:50:58.211495 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.211501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.211728 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.211860 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.212314 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.213467 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.215226 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.215874 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216002 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.216146 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.216793 (+ 647us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.216922 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":85,"threads_started":1}
I20260812 09:50:58.217442 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.211537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45842 (local address 127.11.118.130:46243)
0812 09:50:58.212384 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.212394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.212415 (+ 21us) server_negotiation.cc:407] Connection header received
0812 09:50:58.212489 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.212497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.212655 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.212808 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.212995 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.213871 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.215281 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.216114 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216255 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.216385 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.217160 (+ 775us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.217274 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":749,"thread_start_us":110,"threads_started":1}
I20260812 09:50:58.217841 20735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.210231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:41319 (local address 127.0.0.1:50428)
0812 09:50:58.210950 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.211019 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.211279 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.212052 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.212056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.212090 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.212192 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.212197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.213613 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.213616 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.215095 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.215105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.216241 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.216514 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.216596 (+ 82us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.216720 (+ 124us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.217731 (+ 1011us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":1040,"spinlock_wait_cycles":4736,"thread_start_us":139,"threads_started":1}
I20260812 09:50:58.218853 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.211348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50824 (local address 127.11.118.131:40567)
0812 09:50:58.211780 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.211792 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.212055 (+ 263us) server_negotiation.cc:407] Connection header received
0812 09:50:58.212236 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.212241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.212439 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.212597 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.212854 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.213947 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216057 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.216773 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216929 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.217065 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.218017 (+ 952us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.218707 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":121,"threads_started":1}
I20260812 09:50:58.219214 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.210987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40567 (local address 127.0.0.1:50824)
0812 09:50:58.211938 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.211950 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.212095 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.212608 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.212611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.212629 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.212721 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.212726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.214082 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.214088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.215903 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.215914 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.216942 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.216946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.217035 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.217057 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.217141 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.217216 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":38,"spinlock_wait_cycles":4096,"thread_start_us":185,"threads_started":1}
I20260812 09:50:58.220476 20473 tablet_service.cc:1467] Processing CreateTablet for tablet d8977f57f84547118520b6c91a7ab2b8 (DEFAULT_TABLE table=test-table [id=22a42d2ae2f94516baf9281784dcae45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.220508 20318 tablet_service.cc:1467] Processing CreateTablet for tablet d8977f57f84547118520b6c91a7ab2b8 (DEFAULT_TABLE table=test-table [id=22a42d2ae2f94516baf9281784dcae45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.221493 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8977f57f84547118520b6c91a7ab2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.221549 20318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8977f57f84547118520b6c91a7ab2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.224751 20634 tablet_service.cc:1467] Processing CreateTablet for tablet d8977f57f84547118520b6c91a7ab2b8 (DEFAULT_TABLE table=test-table [id=22a42d2ae2f94516baf9281784dcae45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.226006 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8977f57f84547118520b6c91a7ab2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.228899 20741 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Bootstrap starting.
I20260812 09:50:58.230319 20742 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Bootstrap starting.
I20260812 09:50:58.231240 20741 tablet_bootstrap.cc:654] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.232126 20741 log.cc:824] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:58.232731 20742 tablet_bootstrap.cc:654] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.233631 20742 log.cc:824] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:58.234613 20741 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: No bootstrap required, opened a new log
I20260812 09:50:58.234875 20741 ts_tablet_manager.cc:1397] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:50:58.236624 20742 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: No bootstrap required, opened a new log
I20260812 09:50:58.236886 20742 ts_tablet_manager.cc:1397] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 09:50:58.238549 20741 raft_consensus.cc:348] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.238849 20741 raft_consensus.cc:374] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.238920 20741 raft_consensus.cc:729] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.239441 20745 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Bootstrap starting.
I20260812 09:50:58.239507 20741 consensus_queue.cc:260] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.240870 20741 ts_tablet_manager.cc:1428] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 09:50:58.241315 20550 heartbeater.cc:503] Master 127.11.118.190:39511 was elected leader, sending a full tablet report...
I20260812 09:50:58.242080 20745 tablet_bootstrap.cc:654] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.242144 20742 raft_consensus.cc:348] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.242458 20742 raft_consensus.cc:374] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.242524 20742 raft_consensus.cc:729] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.243016 20745 log.cc:824] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:50:58.243127 20742 consensus_queue.cc:260] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.243849 20389 heartbeater.cc:503] Master 127.11.118.190:39511 was elected leader, sending a full tablet report...
I20260812 09:50:58.244237 20742 ts_tablet_manager.cc:1428] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20260812 09:50:58.245505 20745 tablet_bootstrap.cc:492] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: No bootstrap required, opened a new log
I20260812 09:50:58.245721 20745 ts_tablet_manager.cc:1397] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.003s
I20260812 09:50:58.250233 20745 raft_consensus.cc:348] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.250557 20745 raft_consensus.cc:374] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.250625 20745 raft_consensus.cc:729] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.251142 20745 consensus_queue.cc:260] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.251950 20709 heartbeater.cc:503] Master 127.11.118.190:39511 was elected leader, sending a full tablet report...
I20260812 09:50:58.252199 20745 ts_tablet_manager.cc:1428] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:50:58.324728 20747 raft_consensus.cc:482] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:58.324947 20747 raft_consensus.cc:504] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.326215 20747 leader_election.cc:288] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:58.332242 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.327196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:56933 (local address 127.11.118.131:40567)
0812 09:50:58.327344 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.327349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.327519 (+ 170us) server_negotiation.cc:407] Connection header received
0812 09:50:58.327585 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.327588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.327630 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.327691 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.327987 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.328723 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.330615 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.331377 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.331516 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.331571 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.332030 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.332114 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:50:58.332244 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.326694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:46031 (local address 127.11.118.130:46243)
0812 09:50:58.326878 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.326884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.327083 (+ 199us) server_negotiation.cc:407] Connection header received
0812 09:50:58.327263 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.327267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.327329 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.327411 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.327798 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.328617 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.330615 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.331383 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.331517 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.331571 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.332052 (+ 481us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.332143 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:50:58.332221 20750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.326535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.11.118.129:46031)
0812 09:50:58.326930 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.326948 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.327124 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.327441 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.327447 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.327473 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.327640 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.327646 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.328746 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.328749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.330287 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.330300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.331529 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.331533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.331733 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.331785 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.331881 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.332007 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":147,"spinlock_wait_cycles":11136,"thread_start_us":151,"threads_started":1}
I20260812 09:50:58.332221 20751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.327067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40567 (local address 127.11.118.129:56933)
0812 09:50:58.327397 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.327412 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.327503 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.327738 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.327742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.327762 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.327869 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.327874 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.328833 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.328836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.330287 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.330300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.331529 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.331533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.331730 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.331792 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.331872 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.332006 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":194,"thread_start_us":114,"threads_started":1}
I20260812 09:50:58.333314 20494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8977f57f84547118520b6c91a7ab2b8" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828" is_pre_election: true
I20260812 09:50:58.333302 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8977f57f84547118520b6c91a7ab2b8" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f" is_pre_election: true
I20260812 09:50:58.333669 20658 raft_consensus.cc:2454] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 0.
I20260812 09:50:58.333670 20494 raft_consensus.cc:2454] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 0.
I20260812 09:50:58.334192 20261 leader_election.cc:302] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e41745ce347d3a5d10c2f1c1b9ed7, a5d7822eaec34a06adeb427c9e292828; no voters:
I20260812 09:50:58.334514 20747 raft_consensus.cc:2781] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:58.334623 20747 raft_consensus.cc:482] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:58.334685 20747 raft_consensus.cc:3037] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.335845 20747 raft_consensus.cc:504] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.336220 20747 leader_election.cc:288] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 election: Requested vote from peers a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:58.336730 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8977f57f84547118520b6c91a7ab2b8" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f"
I20260812 09:50:58.336730 20494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8977f57f84547118520b6c91a7ab2b8" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828"
I20260812 09:50:58.336875 20494 raft_consensus.cc:3037] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.336875 20658 raft_consensus.cc:3037] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.338694 20494 raft_consensus.cc:2454] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 1.
I20260812 09:50:58.338689 20658 raft_consensus.cc:2454] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 1.
I20260812 09:50:58.339056 20261 leader_election.cc:302] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, 2d8e41745ce347d3a5d10c2f1c1b9ed7; no voters:
I20260812 09:50:58.339272 20747 raft_consensus.cc:2781] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:58.339586 20747 raft_consensus.cc:686] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Running, Role: LEADER
I20260812 09:50:58.339986 20747 consensus_queue.cc:237] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.343427 20169 catalog_manager.cc:5495] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:58.372876 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.368984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.11.118.129:41319)
0812 09:50:58.369158 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.369163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.369179 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:50:58.369279 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.369282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.369336 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.369458 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.369717 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.370272 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.371341 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.371590 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.371702 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.371996 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.372453 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.372590 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.372656 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.372723 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 09:50:58.378600 20390 tablet.cc:2369] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:58.379401 20494 raft_consensus.cc:1261] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Refusing update from remote peer 2d8e41745ce347d3a5d10c2f1c1b9ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.379401 20658 raft_consensus.cc:1261] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Refusing update from remote peer 2d8e41745ce347d3a5d10c2f1c1b9ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.380120 20747 consensus_queue.cc:1035] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.380403 20753 consensus_queue.cc:1035] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:50:58.381268 20551 tablet.cc:2369] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:58.387566 20761 mvcc.cc:205] Tried to move back new op lower bound from 7317619746313199616 to 7317619746163740672. Current Snapshot: MvccSnapshot[applied={T|T < 7317619746313199616}]
I20260812 09:50:58.388669 20757 mvcc.cc:205] Tried to move back new op lower bound from 7317619746313199616 to 7317619746163740672. Current Snapshot: MvccSnapshot[applied={T|T < 7317619746313199616}]
I20260812 09:50:58.397451 20168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.397681 20168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.400862 20168 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Sending DeleteTablet for 3 replicas of tablet d8977f57f84547118520b6c91a7ab2b8
I20260812 09:50:58.401844 20473 tablet_service.cc:1514] Processing DeleteTablet for tablet d8977f57f84547118520b6c91a7ab2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45842
I20260812 09:50:58.402132 20634 tablet_service.cc:1514] Processing DeleteTablet for tablet d8977f57f84547118520b6c91a7ab2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50824
I20260812 09:50:58.402446 20768 tablet_replica.cc:330] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: stopping tablet replica
I20260812 09:50:58.402504 20318 tablet_service.cc:1514] Processing DeleteTablet for tablet d8977f57f84547118520b6c91a7ab2b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50428
I20260812 09:50:58.402859 20768 raft_consensus.cc:2229] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:58.403143 20769 tablet_replica.cc:330] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: stopping tablet replica
I20260812 09:50:58.403268 20768 raft_consensus.cc:2258] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.403554 20168 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 09:50:58.404031 20769 raft_consensus.cc:2229] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 09:50:58.404057 20168 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:58.404469 20769 raft_consensus.cc:2258] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.406057 20769 ts_tablet_manager.cc:1905] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.406042 20768 ts_tablet_manager.cc:1905] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.408988 20769 ts_tablet_manager.cc:1918] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:58.409348 20768 ts_tablet_manager.cc:1918] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:58.409512 20769 log.cc:1196] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/d8977f57f84547118520b6c91a7ab2b8
I20260812 09:50:58.409938 20769 ts_tablet_manager.cc:1939] T d8977f57f84547118520b6c91a7ab2b8 P 0ea530bb3779413692f1a024b9f4d84f: Deleting consensus metadata
I20260812 09:50:58.409989 20318 tablet_service.cc:1467] Processing CreateTablet for tablet 965756ed0f3a42b086a15f44766eca55 (DEFAULT_TABLE table=test-table [id=2185f14b8af74460bd735465dbc11f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.410331 20318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965756ed0f3a42b086a15f44766eca55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.410940 20473 tablet_service.cc:1467] Processing CreateTablet for tablet 965756ed0f3a42b086a15f44766eca55 (DEFAULT_TABLE table=test-table [id=2185f14b8af74460bd735465dbc11f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.411253 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965756ed0f3a42b086a15f44766eca55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.412829 20742 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Bootstrap starting.
I20260812 09:50:58.413237 20768 log.cc:1196] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/d8977f57f84547118520b6c91a7ab2b8
I20260812 09:50:58.413620 20741 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Bootstrap starting.
I20260812 09:50:58.413676 20768 ts_tablet_manager.cc:1939] T d8977f57f84547118520b6c91a7ab2b8 P a5d7822eaec34a06adeb427c9e292828: Deleting consensus metadata
I20260812 09:50:58.414111 20742 tablet_bootstrap.cc:654] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.414825 20741 tablet_bootstrap.cc:654] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.415470 20634 tablet_service.cc:1467] Processing CreateTablet for tablet 965756ed0f3a42b086a15f44766eca55 (DEFAULT_TABLE table=test-table [id=2185f14b8af74460bd735465dbc11f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.415763 20742 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: No bootstrap required, opened a new log
I20260812 09:50:58.415841 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 965756ed0f3a42b086a15f44766eca55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.415869 20742 ts_tablet_manager.cc:1397] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260812 09:50:58.416338 20741 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: No bootstrap required, opened a new log
I20260812 09:50:58.416438 20741 ts_tablet_manager.cc:1397] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.416426 20742 raft_consensus.cc:348] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.416569 20742 raft_consensus.cc:374] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.416617 20742 raft_consensus.cc:729] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.416775 20742 consensus_queue.cc:260] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.416961 20741 raft_consensus.cc:348] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.417079 20741 raft_consensus.cc:374] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.417135 20741 raft_consensus.cc:729] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.417264 20741 consensus_queue.cc:260] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.417560 20741 ts_tablet_manager.cc:1428] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:58.417712 20742 ts_tablet_manager.cc:1428] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:58.418514 20148 catalog_manager.cc:4841] TS a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): tablet d8977f57f84547118520b6c91a7ab2b8 (table test-table [id=22a42d2ae2f94516baf9281784dcae45]) successfully deleted
I20260812 09:50:58.418627 20745 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Bootstrap starting.
I20260812 09:50:58.418689 20148 catalog_manager.cc:4841] TS 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567): tablet d8977f57f84547118520b6c91a7ab2b8 (table test-table [id=22a42d2ae2f94516baf9281784dcae45]) successfully deleted
I20260812 09:50:58.419797 20745 tablet_bootstrap.cc:654] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.421262 20745 tablet_bootstrap.cc:492] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: No bootstrap required, opened a new log
I20260812 09:50:58.421389 20745 ts_tablet_manager.cc:1397] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.421813 20745 raft_consensus.cc:348] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.421916 20745 raft_consensus.cc:374] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.421938 20745 raft_consensus.cc:729] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.422088 20745 consensus_queue.cc:260] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.422633 20745 ts_tablet_manager.cc:1428] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:58.423225 20770 tablet_replica.cc:330] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: stopping tablet replica
I20260812 09:50:58.423684 20770 raft_consensus.cc:2229] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:58.424299 20770 raft_consensus.cc:2258] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.426132 20770 ts_tablet_manager.cc:1905] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.428963 20770 ts_tablet_manager.cc:1918] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:58.429102 20770 log.cc:1196] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/d8977f57f84547118520b6c91a7ab2b8
I20260812 09:50:58.429436 20770 ts_tablet_manager.cc:1939] T d8977f57f84547118520b6c91a7ab2b8 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting consensus metadata
I20260812 09:50:58.430831 20149 catalog_manager.cc:4841] TS 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319): tablet d8977f57f84547118520b6c91a7ab2b8 (table test-table [id=22a42d2ae2f94516baf9281784dcae45]) successfully deleted
I20260812 09:50:58.563776 20749 raft_consensus.cc:482] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:58.563942 20749 raft_consensus.cc:504] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.565156 20749 leader_election.cc:288] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319), a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243)
I20260812 09:50:58.570124 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.565449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:41319 (local address 127.11.118.131:54735)
0812 09:50:58.565860 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.565874 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.565964 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.566235 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.566240 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.566254 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.566421 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.566432 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.567310 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.567314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.568809 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.568814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.569697 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.569700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.569787 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.569809 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.569917 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.569983 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":128,"thread_start_us":120,"threads_started":1}
I20260812 09:50:58.570163 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.565875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:54735 (local address 127.11.118.129:41319)
0812 09:50:58.565995 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.565999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.566017 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:58.566074 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.566077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.566128 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.566211 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.566553 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.567178 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.568956 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.569524 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.569662 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.569720 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.569958 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.570036 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 09:50:58.571010 20590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.565422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.11.118.131:52615)
0812 09:50:58.565576 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.565592 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.565692 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.566119 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.566122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.566137 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.566292 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.566300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.567291 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.567294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.568799 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.568813 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.570517 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.570520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.570629 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.570679 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.570765 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.570844 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":74}
I20260812 09:50:58.570890 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "965756ed0f3a42b086a15f44766eca55" candidate_uuid: "0ea530bb3779413692f1a024b9f4d84f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" is_pre_election: true
I20260812 09:50:58.571035 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.565642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:52615 (local address 127.11.118.130:46243)
0812 09:50:58.565860 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.565866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.565883 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:50:58.565945 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.565948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.565998 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.566076 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.566403 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.567152 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.569658 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.570255 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.570391 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.570451 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.570813 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.570888 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260812 09:50:58.571198 20340 raft_consensus.cc:2454] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea530bb3779413692f1a024b9f4d84f in term 0.
I20260812 09:50:58.571601 20493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "965756ed0f3a42b086a15f44766eca55" candidate_uuid: "0ea530bb3779413692f1a024b9f4d84f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828" is_pre_election: true
I20260812 09:50:58.571689 20581 leader_election.cc:302] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, 2d8e41745ce347d3a5d10c2f1c1b9ed7; no voters:
I20260812 09:50:58.571764 20493 raft_consensus.cc:2454] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea530bb3779413692f1a024b9f4d84f in term 0.
I20260812 09:50:58.571944 20749 raft_consensus.cc:2781] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:58.572003 20749 raft_consensus.cc:482] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:58.572037 20749 raft_consensus.cc:3037] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.573107 20749 raft_consensus.cc:504] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.573503 20749 leader_election.cc:288] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319), a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243)
I20260812 09:50:58.573900 20493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "965756ed0f3a42b086a15f44766eca55" candidate_uuid: "0ea530bb3779413692f1a024b9f4d84f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828"
I20260812 09:50:58.573945 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "965756ed0f3a42b086a15f44766eca55" candidate_uuid: "0ea530bb3779413692f1a024b9f4d84f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
I20260812 09:50:58.574041 20493 raft_consensus.cc:3037] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.574059 20340 raft_consensus.cc:3037] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.575357 20493 raft_consensus.cc:2454] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea530bb3779413692f1a024b9f4d84f in term 1.
I20260812 09:50:58.575357 20340 raft_consensus.cc:2454] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea530bb3779413692f1a024b9f4d84f in term 1.
I20260812 09:50:58.575685 20581 leader_election.cc:302] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, 2d8e41745ce347d3a5d10c2f1c1b9ed7; no voters:
I20260812 09:50:58.575914 20749 raft_consensus.cc:2781] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:58.576206 20749 raft_consensus.cc:686] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 1 LEADER]: Becoming Leader. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Running, Role: LEADER
I20260812 09:50:58.576472 20749 consensus_queue.cc:237] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.578943 20169 catalog_manager.cc:5495] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131). New cstate: current_term: 1 leader_uuid: "0ea530bb3779413692f1a024b9f4d84f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } health_report { overall_health: HEALTHY } } }
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528257, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.190@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:58.635468 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.624990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39511 (local address 127.0.0.1:56742)
0812 09:50:58.625411 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.625426 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.625592 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.625943 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.625946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.626362 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:50:58.626466 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.626476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.627570 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.627573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.628196 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.628209 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.628797 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.628800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.628871 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.629574 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:50:58.629586 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:50:58.631368 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:50:58.633531 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.633542 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.633548 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.633816 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.634224 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:50:58.634227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:50:58.634228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:50:58.634331 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:50:58.634790 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:50:58.634795 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:50:58.634919 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.635092 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.635242 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":190,"threads_started":1}
I20260812 09:50:58.635491 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.625081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56742 (local address 127.11.118.190:39511)
0812 09:50:58.625268 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.625274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.625549 (+ 275us) server_negotiation.cc:407] Connection header received
0812 09:50:58.625710 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.625714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.625769 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.625872 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.626614 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.627436 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.628342 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.628633 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.628741 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.631586 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:58.631591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:58.631594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:58.631620 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:58.633408 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.633929 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.633933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.633935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.634025 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.634425 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.634428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.634430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.634656 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:58.634768 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.635157 (+ 389us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.635325 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":90}
I20260812 09:50:58.640101 20169 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:56742:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 09:50:58.641023 20169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 09:50:58.644215 20710 tablet.cc:2369] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:50:58.647004 20473 tablet_service.cc:1467] Processing CreateTablet for tablet f533b2fd10a54dec8f491c0aa494f9a9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4e72ade59288499d8850a12e034177d4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:58.647030 20318 tablet_service.cc:1467] Processing CreateTablet for tablet f533b2fd10a54dec8f491c0aa494f9a9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4e72ade59288499d8850a12e034177d4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:58.647038 20634 tablet_service.cc:1467] Processing CreateTablet for tablet f533b2fd10a54dec8f491c0aa494f9a9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4e72ade59288499d8850a12e034177d4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 09:50:58.647442 20318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533b2fd10a54dec8f491c0aa494f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.647442 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533b2fd10a54dec8f491c0aa494f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.647457 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533b2fd10a54dec8f491c0aa494f9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.650280 20741 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: Bootstrap starting.
I20260812 09:50:58.650306 20742 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Bootstrap starting.
I20260812 09:50:58.650360 20745 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: Bootstrap starting.
I20260812 09:50:58.651329 20742 tablet_bootstrap.cc:654] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.651388 20741 tablet_bootstrap.cc:654] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.651389 20745 tablet_bootstrap.cc:654] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.652575 20742 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: No bootstrap required, opened a new log
I20260812 09:50:58.652704 20742 ts_tablet_manager.cc:1397] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:58.652709 20741 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: No bootstrap required, opened a new log
I20260812 09:50:58.652767 20745 tablet_bootstrap.cc:492] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: No bootstrap required, opened a new log
I20260812 09:50:58.652801 20741 ts_tablet_manager.cc:1397] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.652865 20745 ts_tablet_manager.cc:1397] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.653204 20742 raft_consensus.cc:348] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653347 20742 raft_consensus.cc:374] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.653389 20742 raft_consensus.cc:729] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.653368 20741 raft_consensus.cc:348] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653494 20741 raft_consensus.cc:374] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.653539 20741 raft_consensus.cc:729] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.653539 20742 consensus_queue.cc:260] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653671 20741 consensus_queue.cc:260] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653641 20745 raft_consensus.cc:348] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653771 20745 raft_consensus.cc:374] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.653828 20745 raft_consensus.cc:729] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.653853 20742 ts_tablet_manager.cc:1428] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:58.653966 20745 consensus_queue.cc:260] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.653965 20746 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.654102 20746 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.654080 20747 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.654211 20747 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.654256 20745 ts_tablet_manager.cc:1428] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:58.654458 20749 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.654583 20749 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.655967 20741 ts_tablet_manager.cc:1428] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.700441 20746 raft_consensus.cc:482] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:58.700695 20746 raft_consensus.cc:504] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.702129 20746 leader_election.cc:288] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567), 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319)
I20260812 09:50:58.708251 20790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.702360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40567 (local address 127.11.118.130:54481)
0812 09:50:58.702723 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.702738 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.702876 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.703468 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.703471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.703483 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.703583 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.703592 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.704705 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.704709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.706472 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.706484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.707619 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.707623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.707803 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.707841 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.707942 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.708052 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":126,"thread_start_us":103,"threads_started":1}
I20260812 09:50:58.708267 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.702549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:48091 (local address 127.11.118.129:41319)
0812 09:50:58.702685 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.702692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.703055 (+ 363us) server_negotiation.cc:407] Connection header received
0812 09:50:58.703198 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.703201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.703256 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.703362 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.703735 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.704543 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.706690 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.707389 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.707544 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.707604 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.708057 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.708157 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:58.708577 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.702452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:54481 (local address 127.11.118.131:40567)
0812 09:50:58.702594 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.702600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.702846 (+ 246us) server_negotiation.cc:407] Connection header received
0812 09:50:58.703012 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.703015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.703074 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.703175 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:50:58.703734 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.704543 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.706690 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.707389 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.707544 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.707604 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.708067 (+ 463us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.708421 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:50:58.709024 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.702440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:41319 (local address 127.11.118.130:48091)
0812 09:50:58.702921 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.702935 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.703078 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.703378 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.703381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.703399 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:50:58.703540 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.703550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.704705 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.704709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.706468 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.706484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.707573 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.707578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.707816 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.707902 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.708499 (+ 597us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.708593 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":252,"thread_start_us":108,"threads_started":1}
I20260812 09:50:58.709052 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533b2fd10a54dec8f491c0aa494f9a9" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f" is_pre_election: true
I20260812 09:50:58.709210 20658 raft_consensus.cc:2454] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 0.
I20260812 09:50:58.709687 20416 leader_election.cc:302] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, a5d7822eaec34a06adeb427c9e292828; no voters:
I20260812 09:50:58.709748 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533b2fd10a54dec8f491c0aa494f9a9" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" is_pre_election: true
I20260812 09:50:58.709874 20340 raft_consensus.cc:2454] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 0.
I20260812 09:50:58.710069 20746 raft_consensus.cc:2781] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:58.710161 20746 raft_consensus.cc:482] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:58.710220 20746 raft_consensus.cc:3037] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.711297 20746 raft_consensus.cc:504] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.711730 20746 leader_election.cc:288] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 election: Requested vote from peers 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567), 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319)
I20260812 09:50:58.712106 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533b2fd10a54dec8f491c0aa494f9a9" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f"
I20260812 09:50:58.712251 20658 raft_consensus.cc:3037] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.712293 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533b2fd10a54dec8f491c0aa494f9a9" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
I20260812 09:50:58.712433 20340 raft_consensus.cc:3037] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.713310 20658 raft_consensus.cc:2454] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 1.
I20260812 09:50:58.713414 20340 raft_consensus.cc:2454] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 1.
I20260812 09:50:58.713702 20416 leader_election.cc:302] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, a5d7822eaec34a06adeb427c9e292828; no voters:
I20260812 09:50:58.713900 20746 raft_consensus.cc:2781] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:58.714254 20746 raft_consensus.cc:686] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [term 1 LEADER]: Becoming Leader. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Running, Role: LEADER
I20260812 09:50:58.714546 20746 consensus_queue.cc:237] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } }
I20260812 09:50:58.716096 20791 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: TxnStatusTablet state changed. Reason: New leader a5d7822eaec34a06adeb427c9e292828. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.716249 20791 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:58.716722 20793 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 09:50:58.716895 20793 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 09:50:58.717625 20167 catalog_manager.cc:5495] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5d7822eaec34a06adeb427c9e292828 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:58.744293 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.738886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.0.0.1:33426)
0812 09:50:58.739115 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.739134 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.739272 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.739814 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.739820 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.739833 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:58.740016 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.740024 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.741413 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.741417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.742058 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.742069 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.742726 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.742729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.742831 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.742935 (+ 104us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.743973 (+ 1038us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.743990 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.744069 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.744165 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 09:50:58.744339 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.739115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.11.118.130:46243)
0812 09:50:58.739282 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.739287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.739305 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:50:58.739418 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.739421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.739495 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.739600 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.740182 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.741202 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.742204 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.742559 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.742689 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.743209 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.743808 (+ 599us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.743946 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.744110 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.744176 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:50:58.747949 20658 raft_consensus.cc:1261] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Refusing update from remote peer a5d7822eaec34a06adeb427c9e292828: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.748159 20340 raft_consensus.cc:1261] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Refusing update from remote peer a5d7822eaec34a06adeb427c9e292828: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.748561 20746 consensus_queue.cc:1035] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.748750 20791 consensus_queue.cc:1035] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.750608 20747 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: TxnStatusTablet state changed. Reason: New leader a5d7822eaec34a06adeb427c9e292828. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.750655 20749 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: TxnStatusTablet state changed. Reason: New leader a5d7822eaec34a06adeb427c9e292828. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.750773 20749 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.750771 20747 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.752523 20758 mvcc.cc:205] Tried to move back new op lower bound from 7317619747825451008 to 7317619747697901568. Current Snapshot: MvccSnapshot[applied={T|T < 7317619747825451008}]
I20260812 09:50:58.753072 20746 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.753198 20746 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:58.753993 20746 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.754091 20746 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P a5d7822eaec34a06adeb427c9e292828: This TxnStatusTablet replica's current role is: LEADER
I20260812 09:50:58.754498 20747 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.754619 20747 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.757048 20749 tablet_replica.cc:439] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } } peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } }
I20260812 09:50:58.757186 20749 tablet_replica.cc:442] T f533b2fd10a54dec8f491c0aa494f9a9 P 0ea530bb3779413692f1a024b9f4d84f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 09:50:58.764287 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.758655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43054 (local address 127.11.118.131:40567)
0812 09:50:58.758945 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.758949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.759014 (+ 65us) server_negotiation.cc:407] Connection header received
0812 09:50:58.759858 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.759864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.759958 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.760080 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.760504 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.761347 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.762664 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.762932 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.763090 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.763365 (+ 275us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.763831 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.763931 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.764044 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.764099 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260812 09:50:58.777165 20802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.771949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.11.118.131:38239)
0812 09:50:58.772258 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.772280 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.772358 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.772687 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.772691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.772698 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:58.772877 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.772883 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.774944 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.774947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.775722 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.775734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.776354 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.776357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.776447 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.776512 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.776871 (+ 359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.776878 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.776948 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.777024 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":118,"threads_started":1}
I20260812 09:50:58.777181 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.772167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:38239 (local address 127.11.118.130:46243)
0812 09:50:58.772299 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.772304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.772344 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:50:58.772468 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.772472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.772528 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.772610 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.772976 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.774758 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.775864 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.776214 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.776325 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.776659 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.776756 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.776833 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.776982 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.777041 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 09:50:58.785341 20493 raft_consensus.cc:1261] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Refusing update from remote peer 0ea530bb3779413692f1a024b9f4d84f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.785342 20340 raft_consensus.cc:1261] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Refusing update from remote peer 0ea530bb3779413692f1a024b9f4d84f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.785903 20749 consensus_queue.cc:1035] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.786163 20775 consensus_queue.cc:1035] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.811157 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.806936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:34487 (local address 127.11.118.131:40567)
0812 09:50:58.807100 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.807105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.807357 (+ 252us) server_negotiation.cc:407] Connection header received
0812 09:50:58.807475 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.807477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.807521 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.807586 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.808019 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.808743 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.809990 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.810216 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.810336 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.810664 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.810740 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.810794 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.810920 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.811028 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 09:50:58.811211 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.806834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40567 (local address 127.11.118.130:34487)
0812 09:50:58.807239 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:58.807256 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:58.807389 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:58.807624 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:58.807627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:58.807635 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:58.807781 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.807787 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.808870 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.808874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.809865 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:58.809877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.810345 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.810349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:58.810452 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.810521 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.810831 (+ 310us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.810838 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:50:58.810911 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 09:50:58.811029 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":182,"threads_started":1}
I20260812 09:50:58.843844 20167 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.844062 20167 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.846912 20167 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Sending DeleteTablet for 3 replicas of tablet 965756ed0f3a42b086a15f44766eca55
I20260812 09:50:58.847770 20634 tablet_service.cc:1514] Processing DeleteTablet for tablet 965756ed0f3a42b086a15f44766eca55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50824
I20260812 09:50:58.847777 20318 tablet_service.cc:1514] Processing DeleteTablet for tablet 965756ed0f3a42b086a15f44766eca55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50428
I20260812 09:50:58.847998 20770 tablet_replica.cc:330] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: stopping tablet replica
I20260812 09:50:58.847995 20769 tablet_replica.cc:330] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: stopping tablet replica
I20260812 09:50:58.848129 20769 raft_consensus.cc:2229] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:58.848146 20770 raft_consensus.cc:2229] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:58.848320 20770 raft_consensus.cc:2258] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.848459 20769 raft_consensus.cc:2258] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.849426 20769 ts_tablet_manager.cc:1905] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.849426 20770 ts_tablet_manager.cc:1905] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.852625 20770 ts_tablet_manager.cc:1918] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:58.852625 20769 ts_tablet_manager.cc:1918] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:58.852716 20769 log.cc:1196] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/965756ed0f3a42b086a15f44766eca55
I20260812 09:50:58.852717 20770 log.cc:1196] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/965756ed0f3a42b086a15f44766eca55
I20260812 09:50:58.853008 20770 ts_tablet_manager.cc:1939] T 965756ed0f3a42b086a15f44766eca55 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting consensus metadata
I20260812 09:50:58.853013 20769 ts_tablet_manager.cc:1939] T 965756ed0f3a42b086a15f44766eca55 P 0ea530bb3779413692f1a024b9f4d84f: Deleting consensus metadata
I20260812 09:50:58.853303 20473 tablet_service.cc:1514] Processing DeleteTablet for tablet 965756ed0f3a42b086a15f44766eca55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45842
I20260812 09:50:58.853575 20768 tablet_replica.cc:330] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: stopping tablet replica
I20260812 09:50:58.853710 20768 raft_consensus.cc:2229] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:58.853864 20768 raft_consensus.cc:2258] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.855098 20768 ts_tablet_manager.cc:1905] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.858374 20768 ts_tablet_manager.cc:1918] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:58.858474 20768 log.cc:1196] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/965756ed0f3a42b086a15f44766eca55
I20260812 09:50:58.858765 20768 ts_tablet_manager.cc:1939] T 965756ed0f3a42b086a15f44766eca55 P a5d7822eaec34a06adeb427c9e292828: Deleting consensus metadata
I20260812 09:50:58.860095 20149 catalog_manager.cc:4841] TS 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319): tablet 965756ed0f3a42b086a15f44766eca55 (table test-table [id=2185f14b8af74460bd735465dbc11f32]) successfully deleted
I20260812 09:50:58.861091 20148 catalog_manager.cc:4841] TS 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567): tablet 965756ed0f3a42b086a15f44766eca55 (table test-table [id=2185f14b8af74460bd735465dbc11f32]) successfully deleted
I20260812 09:50:58.861884 20148 catalog_manager.cc:4841] TS a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): tablet 965756ed0f3a42b086a15f44766eca55 (table test-table [id=2185f14b8af74460bd735465dbc11f32]) successfully deleted
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 09:50:58.901181 20222 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:50:58.884248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56758 (local address 127.11.118.190:39511)
0812 09:50:58.884394 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.884399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.887437 (+ 3038us) server_negotiation.cc:407] Connection header received
0812 09:50:58.887706 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.887710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.887772 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.887837 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.889031 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.889883 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.891466 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.891816 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.891921 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.901026 (+ 9105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56758: BlockingRecv error: recv got EOF from 127.0.0.1:56758 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 09:50:58 dist-test-slave-2w3w krb5kdc[20115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM
I20260812 09:50:58.916447 20222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.904453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.11.118.190:39511)
0812 09:50:58.904575 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.904579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.905119 (+ 540us) server_negotiation.cc:407] Connection header received
0812 09:50:58.905317 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.905321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.905386 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.905441 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:50:58.906466 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.907261 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.908547 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.908903 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.909023 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.912343 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:50:58.912350 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:50:58.912356 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:50:58.912415 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:50:58.914352 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.914988 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.914992 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.914994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.915097 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:50:58.915429 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:50:58.915432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:50:58.915434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:50:58.915682 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:50:58.915823 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.916112 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.916254 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 09:50:58.919927 20167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:58.920449 20167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:58.926374 20473 tablet_service.cc:1467] Processing CreateTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 (DEFAULT_TABLE table=test-table [id=baf3d403ba454358997f11b855c2f21d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.926369 20318 tablet_service.cc:1467] Processing CreateTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 (DEFAULT_TABLE table=test-table [id=baf3d403ba454358997f11b855c2f21d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.926739 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1187a0f739b9406bad59f40cdd7577c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.926740 20318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1187a0f739b9406bad59f40cdd7577c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.928951 20741 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Bootstrap starting.
I20260812 09:50:58.929282 20742 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Bootstrap starting.
I20260812 09:50:58.929965 20741 tablet_bootstrap.cc:654] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.930321 20742 tablet_bootstrap.cc:654] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.930346 20634 tablet_service.cc:1467] Processing CreateTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 (DEFAULT_TABLE table=test-table [id=baf3d403ba454358997f11b855c2f21d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.930680 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1187a0f739b9406bad59f40cdd7577c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.932001 20742 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: No bootstrap required, opened a new log
I20260812 09:50:58.932113 20742 ts_tablet_manager.cc:1397] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 09:50:58.932587 20742 raft_consensus.cc:348] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.932720 20742 raft_consensus.cc:374] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.932754 20742 raft_consensus.cc:729] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.933282 20742 consensus_queue.cc:260] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.933533 20745 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Bootstrap starting.
I20260812 09:50:58.934062 20742 ts_tablet_manager.cc:1428] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 09:50:58.934563 20745 tablet_bootstrap.cc:654] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.936250 20745 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: No bootstrap required, opened a new log
I20260812 09:50:58.936354 20745 ts_tablet_manager.cc:1397] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 09:50:58.936765 20745 raft_consensus.cc:348] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.936903 20745 raft_consensus.cc:374] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.936944 20745 raft_consensus.cc:729] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.937090 20745 consensus_queue.cc:260] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.937378 20745 ts_tablet_manager.cc:1428] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 09:50:58.938423 20741 tablet_bootstrap.cc:492] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: No bootstrap required, opened a new log
I20260812 09:50:58.938562 20741 ts_tablet_manager.cc:1397] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260812 09:50:58.939070 20741 raft_consensus.cc:348] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.939201 20741 raft_consensus.cc:374] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:58.939240 20741 raft_consensus.cc:729] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Initialized, Role: FOLLOWER
I20260812 09:50:58.939390 20741 consensus_queue.cc:260] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.939692 20741 ts_tablet_manager.cc:1428] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:58.941093 20798 raft_consensus.cc:482] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:58.941200 20798 raft_consensus.cc:504] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.941567 20798 leader_election.cc:288] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:58.942097 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1187a0f739b9406bad59f40cdd7577c1" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f" is_pre_election: true
I20260812 09:50:58.942252 20658 raft_consensus.cc:2454] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 0.
I20260812 09:50:58.942570 20416 leader_election.cc:302] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, a5d7822eaec34a06adeb427c9e292828; no voters:
I20260812 09:50:58.943017 20798 raft_consensus.cc:2781] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:58.943099 20798 raft_consensus.cc:482] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:58.943145 20798 raft_consensus.cc:3037] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.943117 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1187a0f739b9406bad59f40cdd7577c1" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" is_pre_election: true
I20260812 09:50:58.943284 20340 raft_consensus.cc:2454] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 0.
I20260812 09:50:58.944720 20798 raft_consensus.cc:504] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.945186 20798 leader_election.cc:288] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:58.945590 20340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1187a0f739b9406bad59f40cdd7577c1" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7"
I20260812 09:50:58.945770 20340 raft_consensus.cc:3037] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.945794 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1187a0f739b9406bad59f40cdd7577c1" candidate_uuid: "a5d7822eaec34a06adeb427c9e292828" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f"
I20260812 09:50:58.945942 20658 raft_consensus.cc:3037] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:58.947446 20658 raft_consensus.cc:2454] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 1.
I20260812 09:50:58.947825 20416 leader_election.cc:302] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, a5d7822eaec34a06adeb427c9e292828; no voters:
I20260812 09:50:58.948555 20340 raft_consensus.cc:2454] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d7822eaec34a06adeb427c9e292828 in term 1.
I20260812 09:50:58.948747 20798 raft_consensus.cc:2781] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:58.948925 20798 raft_consensus.cc:686] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 1 LEADER]: Becoming Leader. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Running, Role: LEADER
I20260812 09:50:58.949074 20798 consensus_queue.cc:237] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:58.950884 20169 catalog_manager.cc:5495] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5d7822eaec34a06adeb427c9e292828 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "a5d7822eaec34a06adeb427c9e292828" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:58.964212 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:58.960899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33434 (local address 127.11.118.130:46243)
0812 09:50:58.961078 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:58.961084 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:58.961100 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:50:58.961159 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:58.961162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:58.961202 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:58.961288 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:58.961549 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.962077 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.963033 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:58.963284 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:58.963426 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:58.963711 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:58.963794 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:58.963882 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:58.963985 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 09:50:58.964049 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 09:50:58.967008 20340 raft_consensus.cc:1261] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Refusing update from remote peer a5d7822eaec34a06adeb427c9e292828: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.967412 20658 raft_consensus.cc:1261] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Refusing update from remote peer a5d7822eaec34a06adeb427c9e292828: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:58.967536 20798 consensus_queue.cc:1035] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.967917 20798 consensus_queue.cc:1035] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:58.979887 20167 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.980073 20167 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:58.982461 20167 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Sending DeleteTablet for 3 replicas of tablet 1187a0f739b9406bad59f40cdd7577c1
I20260812 09:50:58.983160 20473 tablet_service.cc:1514] Processing DeleteTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45842
I20260812 09:50:58.983355 20768 tablet_replica.cc:330] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: stopping tablet replica
I20260812 09:50:58.983342 20634 tablet_service.cc:1514] Processing DeleteTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50824
I20260812 09:50:58.983474 20768 raft_consensus.cc:2229] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:58.983561 20769 tablet_replica.cc:330] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: stopping tablet replica
I20260812 09:50:58.983675 20769 raft_consensus.cc:2229] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:58.983806 20769 raft_consensus.cc:2258] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.983809 20768 raft_consensus.cc:2258] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.984330 20318 tablet_service.cc:1514] Processing DeleteTablet for tablet 1187a0f739b9406bad59f40cdd7577c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:58 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50428
I20260812 09:50:58.984563 20770 tablet_replica.cc:330] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: stopping tablet replica
I20260812 09:50:58.984700 20770 raft_consensus.cc:2229] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:58.984848 20770 raft_consensus.cc:2258] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:58.985713 20770 ts_tablet_manager.cc:1905] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.985718 20769 ts_tablet_manager.cc:1905] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.988346 20770 ts_tablet_manager.cc:1918] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:58.988346 20769 ts_tablet_manager.cc:1918] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:58.988440 20770 log.cc:1196] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/1187a0f739b9406bad59f40cdd7577c1
I20260812 09:50:58.988440 20769 log.cc:1196] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/1187a0f739b9406bad59f40cdd7577c1
I20260812 09:50:58.988718 20770 ts_tablet_manager.cc:1939] T 1187a0f739b9406bad59f40cdd7577c1 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting consensus metadata
I20260812 09:50:58.988718 20769 ts_tablet_manager.cc:1939] T 1187a0f739b9406bad59f40cdd7577c1 P 0ea530bb3779413692f1a024b9f4d84f: Deleting consensus metadata
I20260812 09:50:58.989485 20149 catalog_manager.cc:4841] TS 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319): tablet 1187a0f739b9406bad59f40cdd7577c1 (table test-table [id=baf3d403ba454358997f11b855c2f21d]) successfully deleted
I20260812 09:50:58.989485 20148 catalog_manager.cc:4841] TS 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567): tablet 1187a0f739b9406bad59f40cdd7577c1 (table test-table [id=baf3d403ba454358997f11b855c2f21d]) successfully deleted
I20260812 09:50:58.989681 20167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:50:58.990190 20167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:50:58.995337 20318 tablet_service.cc:1467] Processing CreateTablet for tablet 2588e6e3a0954556a0e925415b1f8675 (DEFAULT_TABLE table=test-table [id=1d013eb9c4de4311b0d46f51bad621fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.995694 20318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2588e6e3a0954556a0e925415b1f8675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.995744 20634 tablet_service.cc:1467] Processing CreateTablet for tablet 2588e6e3a0954556a0e925415b1f8675 (DEFAULT_TABLE table=test-table [id=1d013eb9c4de4311b0d46f51bad621fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:58.996007 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2588e6e3a0954556a0e925415b1f8675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:58.996184 20768 ts_tablet_manager.cc:1905] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:58.998313 20742 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Bootstrap starting.
I20260812 09:50:58.998483 20745 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Bootstrap starting.
I20260812 09:50:58.999338 20742 tablet_bootstrap.cc:654] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:58.999369 20745 tablet_bootstrap.cc:654] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:59.000525 20473 tablet_service.cc:1467] Processing CreateTablet for tablet 2588e6e3a0954556a0e925415b1f8675 (DEFAULT_TABLE table=test-table [id=1d013eb9c4de4311b0d46f51bad621fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:50:59.001055 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2588e6e3a0954556a0e925415b1f8675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:50:59.002024 20745 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: No bootstrap required, opened a new log
I20260812 09:50:59.002126 20745 ts_tablet_manager.cc:1397] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 09:50:59.002663 20745 raft_consensus.cc:348] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.002794 20745 raft_consensus.cc:374] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:59.002831 20745 raft_consensus.cc:729] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea530bb3779413692f1a024b9f4d84f, State: Initialized, Role: FOLLOWER
I20260812 09:50:59.002974 20745 consensus_queue.cc:260] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.003297 20745 ts_tablet_manager.cc:1428] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 09:50:59.004282 20742 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: No bootstrap required, opened a new log
I20260812 09:50:59.004392 20742 ts_tablet_manager.cc:1397] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260812 09:50:59.004884 20742 raft_consensus.cc:348] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.005054 20742 raft_consensus.cc:374] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:59.005112 20742 raft_consensus.cc:729] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Initialized, Role: FOLLOWER
I20260812 09:50:59.005792 20742 consensus_queue.cc:260] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.006111 20742 ts_tablet_manager.cc:1428] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 09:50:59.006642 20741 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Bootstrap starting.
I20260812 09:50:59.010601 20747 raft_consensus.cc:482] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:50:59.010735 20747 raft_consensus.cc:504] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.011214 20747 leader_election.cc:288] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:59.011761 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2588e6e3a0954556a0e925415b1f8675" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f" is_pre_election: true
I20260812 09:50:59.011919 20741 tablet_bootstrap.cc:654] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Neither blocks nor log segments found. Creating new log.
I20260812 09:50:59.011924 20658 raft_consensus.cc:2454] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 0.
I20260812 09:50:59.012187 20493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2588e6e3a0954556a0e925415b1f8675" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828" is_pre_election: true
W20260812 09:50:59.013121 20261 leader_election.cc:341] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): Illegal state: must be running to vote when last-logged opid is not known
I20260812 09:50:59.013361 20261 leader_election.cc:302] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, 2d8e41745ce347d3a5d10c2f1c1b9ed7; no voters: a5d7822eaec34a06adeb427c9e292828
I20260812 09:50:59.013686 20747 raft_consensus.cc:2781] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:50:59.013779 20747 raft_consensus.cc:482] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:50:59.013850 20747 raft_consensus.cc:3037] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:59.015559 20747 raft_consensus.cc:504] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.015946 20747 leader_election.cc:288] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 election: Requested vote from peers a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243), 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567)
I20260812 09:50:59.016640 20658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2588e6e3a0954556a0e925415b1f8675" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea530bb3779413692f1a024b9f4d84f"
I20260812 09:50:59.016783 20658 raft_consensus.cc:3037] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:59.017241 20493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2588e6e3a0954556a0e925415b1f8675" candidate_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d7822eaec34a06adeb427c9e292828"
I20260812 09:50:59.017434 20768 ts_tablet_manager.cc:1918] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:50:59.017515 20768 log.cc:1196] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/1187a0f739b9406bad59f40cdd7577c1
W20260812 09:50:59.017659 20261 leader_election.cc:341] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): Illegal state: must be running to vote when last-logged opid is not known
I20260812 09:50:59.017822 20768 ts_tablet_manager.cc:1939] T 1187a0f739b9406bad59f40cdd7577c1 P a5d7822eaec34a06adeb427c9e292828: Deleting consensus metadata
I20260812 09:50:59.018051 20658 raft_consensus.cc:2454] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e41745ce347d3a5d10c2f1c1b9ed7 in term 1.
I20260812 09:50:59.018733 20261 leader_election.cc:302] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ea530bb3779413692f1a024b9f4d84f, 2d8e41745ce347d3a5d10c2f1c1b9ed7; no voters: a5d7822eaec34a06adeb427c9e292828
I20260812 09:50:59.018894 20148 catalog_manager.cc:4841] TS a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): tablet 1187a0f739b9406bad59f40cdd7577c1 (table test-table [id=baf3d403ba454358997f11b855c2f21d]) successfully deleted
I20260812 09:50:59.019153 20747 raft_consensus.cc:2781] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:50:59.019332 20747 raft_consensus.cc:686] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e41745ce347d3a5d10c2f1c1b9ed7, State: Running, Role: LEADER
I20260812 09:50:59.019486 20747 consensus_queue.cc:237] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.021016 20741 tablet_bootstrap.cc:492] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: No bootstrap required, opened a new log
I20260812 09:50:59.021129 20741 ts_tablet_manager.cc:1397] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260812 09:50:59.021309 20167 catalog_manager.cc:5495] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } health_report { overall_health: UNKNOWN } } }
I20260812 09:50:59.021654 20741 raft_consensus.cc:348] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.021787 20741 raft_consensus.cc:374] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:50:59.021823 20741 raft_consensus.cc:729] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d7822eaec34a06adeb427c9e292828, State: Initialized, Role: FOLLOWER
I20260812 09:50:59.021955 20741 consensus_queue.cc:260] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e41745ce347d3a5d10c2f1c1b9ed7" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 41319 } } peers { permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 } } peers { permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 } }
I20260812 09:50:59.022269 20741 ts_tablet_manager.cc:1428] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260812 09:50:59.048292 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:59.043191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.11.118.129:41319)
0812 09:50:59.043322 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:59.043329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:59.043344 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:50:59.043399 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:59.043405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:59.043463 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:59.043549 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:59.044033 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.044873 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.046282 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.046705 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.046829 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:59.047294 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:59.047405 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:59.047481 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:59.048027 (+ 546us) server_negotiation.cc:299] Negotiation successful
0812 09:50:59.048104 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:50:59.061932 20839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:59.056903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:46243 (local address 127.11.118.129:55165)
0812 09:50:59.057225 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:59.057240 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:59.057371 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:59.057953 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:59.057956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:59.057964 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:59.058082 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:59.058089 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.059235 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.059239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:59.060402 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:59.060412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.061064 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.061067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:59.061164 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:59.061224 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:59.061606 (+ 382us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:59.061615 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 09:50:59.061686 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 09:50:59.061778 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":127,"threads_started":1}
I20260812 09:50:59.061931 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:59.056623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:55165 (local address 127.11.118.130:46243)
0812 09:50:59.056782 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:59.056789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:59.057321 (+ 532us) server_negotiation.cc:407] Connection header received
0812 09:50:59.057792 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:59.057796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:59.057855 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:59.057938 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:59.058198 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.059126 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.060535 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.060940 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.061058 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:59.061422 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:59.061526 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:59.061602 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:59.061708 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 09:50:59.061778 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:50:59.070827 20493 raft_consensus.cc:3037] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:50:59.071067 20658 raft_consensus.cc:1261] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Refusing update from remote peer 2d8e41745ce347d3a5d10c2f1c1b9ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:59.071537 20833 consensus_queue.cc:1035] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea530bb3779413692f1a024b9f4d84f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:59.072433 20493 raft_consensus.cc:1261] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Refusing update from remote peer 2d8e41745ce347d3a5d10c2f1c1b9ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:50:59.073925 20833 consensus_queue.cc:1035] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d7822eaec34a06adeb427c9e292828" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:50:59.102226 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:59.097419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:41319 (local address 127.11.118.130:49051)
0812 09:50:59.097622 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 09:50:59.097638 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:50:59.097757 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:50:59.098039 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:50:59.098044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:50:59.098054 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 09:50:59.098188 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:59.098198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.099442 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.099447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:59.100564 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:50:59.100578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.101410 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.101413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:50:59.101498 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:59.101534 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 09:50:59.101864 (+ 330us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 09:50:59.101872 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 09:50:59.101935 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 09:50:59.102054 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 09:50:59.102614 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:50:59.097485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:49051 (local address 127.11.118.129:41319)
0812 09:50:59.097644 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:50:59.097649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:50:59.097695 (+ 46us) server_negotiation.cc:407] Connection header received
0812 09:50:59.097879 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:50:59.097882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:50:59.097935 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:50:59.098002 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:50:59.098301 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.099113 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.100738 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:50:59.101183 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:50:59.101287 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:50:59.101651 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:50:59.101741 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:50:59.101811 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 09:50:59.102428 (+ 617us) server_negotiation.cc:299] Negotiation successful
0812 09:50:59.102492 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 09:50:59.128294 20167 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:59.128471 20167 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:50:59.130729 20167 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 745e0d169dde473fa5d162d27a1797c1: Sending DeleteTablet for 3 replicas of tablet 2588e6e3a0954556a0e925415b1f8675
I20260812 09:50:59.131500 20473 tablet_service.cc:1514] Processing DeleteTablet for tablet 2588e6e3a0954556a0e925415b1f8675 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:59 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45842
I20260812 09:50:59.131474 20318 tablet_service.cc:1514] Processing DeleteTablet for tablet 2588e6e3a0954556a0e925415b1f8675 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:59 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50428
I20260812 09:50:59.131819 20768 tablet_replica.cc:330] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: stopping tablet replica
I20260812 09:50:59.131819 20770 tablet_replica.cc:330] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: stopping tablet replica
I20260812 09:50:59.131826 20634 tablet_service.cc:1514] Processing DeleteTablet for tablet 2588e6e3a0954556a0e925415b1f8675 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:50:59 UTC) from {username='oryx', principal='oryx/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50824
I20260812 09:50:59.131946 20770 raft_consensus.cc:2229] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:50:59.131951 20768 raft_consensus.cc:2229] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:59.132051 20769 tablet_replica.cc:330] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: stopping tablet replica
I20260812 09:50:59.132082 20768 raft_consensus.cc:2258] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:59.132158 20769 raft_consensus.cc:2229] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:50:59.132177 20770 raft_consensus.cc:2258] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:59.132287 20769 raft_consensus.cc:2258] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:50:59.133028 20768 ts_tablet_manager.cc:1905] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:59.133262 20769 ts_tablet_manager.cc:1905] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:59.133586 20770 ts_tablet_manager.cc:1905] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:50:59.135835 20769 ts_tablet_manager.cc:1918] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:59.135926 20769 log.cc:1196] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/2588e6e3a0954556a0e925415b1f8675
I20260812 09:50:59.136186 20769 ts_tablet_manager.cc:1939] T 2588e6e3a0954556a0e925415b1f8675 P 0ea530bb3779413692f1a024b9f4d84f: Deleting consensus metadata
I20260812 09:50:59.136279 20768 ts_tablet_manager.cc:1918] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:59.136279 20770 ts_tablet_manager.cc:1918] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 09:50:59.136358 20768 log.cc:1196] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/2588e6e3a0954556a0e925415b1f8675
I20260812 09:50:59.136358 20770 log.cc:1196] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/2588e6e3a0954556a0e925415b1f8675
I20260812 09:50:59.136636 20770 ts_tablet_manager.cc:1939] T 2588e6e3a0954556a0e925415b1f8675 P 2d8e41745ce347d3a5d10c2f1c1b9ed7: Deleting consensus metadata
I20260812 09:50:59.136658 20768 ts_tablet_manager.cc:1939] T 2588e6e3a0954556a0e925415b1f8675 P a5d7822eaec34a06adeb427c9e292828: Deleting consensus metadata
I20260812 09:50:59.137243 20148 catalog_manager.cc:4841] TS 0ea530bb3779413692f1a024b9f4d84f (127.11.118.131:40567): tablet 2588e6e3a0954556a0e925415b1f8675 (table test-table [id=1d013eb9c4de4311b0d46f51bad621fe]) successfully deleted
I20260812 09:50:59.137840 20149 catalog_manager.cc:4841] TS 2d8e41745ce347d3a5d10c2f1c1b9ed7 (127.11.118.129:41319): tablet 2588e6e3a0954556a0e925415b1f8675 (table test-table [id=1d013eb9c4de4311b0d46f51bad621fe]) successfully deleted
I20260812 09:50:59.137850 20148 catalog_manager.cc:4841] TS a5d7822eaec34a06adeb427c9e292828 (127.11.118.130:46243): tablet 2588e6e3a0954556a0e925415b1f8675 (table test-table [id=1d013eb9c4de4311b0d46f51bad621fe]) successfully deleted
I20260812 09:50:59.139139 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20245
I20260812 09:50:59.156304 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20398
I20260812 09:50:59.167559 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20560
I20260812 09:50:59.178851 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20131
2026-08-12T09:50:59Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3348 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:50:59 dist-test-slave-2w3w krb5kdc[20846](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:50:59 dist-test-slave-2w3w krb5kdc[20846](info): set up 2 sockets
Aug 12 09:50:59 dist-test-slave-2w3w krb5kdc[20846](info): commencing operation
krb5kdc: starting...
W20260812 09:51:00.334350 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:51:00 dist-test-slave-2w3w krb5kdc[20846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:51:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:51:00.480603 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37893
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:39979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:00.602041 20859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:00.602421 20859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:00.602506 20859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:00.606796 20859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:00.606935 20859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:00.606974 20859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:00.607031 20859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:00.607066 20859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:00.613580 20859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:00.615051 20859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:00.616403 20859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:00.626231 20866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:00.626235 20865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:00.626294 20859 server_base.cc:1034] running on GCE node
W20260812 09:51:00.626231 20869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:00.627617 20859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:00.628844 20859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:00.630043 20859 hybrid_clock.cc:648] HybridClock initialized: now 1786528260630011 us; error 51 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T09:51:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1456 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:51:00 dist-test-slave-2w3w krb5kdc[20878](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:51:00 dist-test-slave-2w3w krb5kdc[20878](info): set up 2 sockets
Aug 12 09:51:00 dist-test-slave-2w3w krb5kdc[20878](info): commencing operation
krb5kdc: starting...
W20260812 09:51:01.799504 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:51:01 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:51:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:51:01.943590 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45543
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:02.066002 20892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:02.066375 20892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:02.066459 20892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:02.070948 20892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:02.071113 20892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:02.071153 20892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:02.071195 20892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:02.071239 20892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:02.077353 20892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:02.078647 20892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:02.079814 20892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:02.089345 20898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.089386 20901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.089347 20899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:02.089776 20892 server_base.cc:1034] running on GCE node
I20260812 09:51:02.090422 20892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:02.091841 20892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:02.093083 20892 hybrid_clock.cc:648] HybridClock initialized: now 1786528262093045 us; error 37 us; skew 500 ppm
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:02.096292 20892 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:51:02.097350 20892 webserver.cc:460] Webserver started at http://127.11.118.190:34871/ using document root <none> and password file <none>
I20260812 09:51:02.097987 20892 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:02.098081 20892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:02.098330 20892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:02.100564 20892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "483bbdd57fec41a68cd023ed9e0b8c60"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "607d23cf43b497c8470fbca607e08e56"
server_key_iv: "ba70d1869943cd050553edf08540488d"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.101172 20892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "483bbdd57fec41a68cd023ed9e0b8c60"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "607d23cf43b497c8470fbca607e08e56"
server_key_iv: "ba70d1869943cd050553edf08540488d"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.105273 20892 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:51:02.108057 20909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.109469 20892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:02.109633 20892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "483bbdd57fec41a68cd023ed9e0b8c60"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "607d23cf43b497c8470fbca607e08e56"
server_key_iv: "ba70d1869943cd050553edf08540488d"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.109766 20892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:02.130137 20892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:02.133584 20892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:02.133826 20892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:02.141849 20892 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:45543
I20260812 09:51:02.141878 20966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:45543 every 8 connection(s)
I20260812 09:51:02.143085 20892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:51:02.146099 20967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:02.152238 20967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Bootstrap starting.
I20260812 09:51:02.152347 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20892
I20260812 09:51:02.152490 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:51:02.152818 11738 external_mini_cluster.cc:1428] Setting key 4a5709e5699ebde26d25968c2dcaa47c
I20260812 09:51:02.155270 20967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:02.156076 20967 log.cc:824] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:02.158270 20967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: No bootstrap required, opened a new log
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:02.162321 20967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:02.162667 20967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:02.162734 20967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483bbdd57fec41a68cd023ed9e0b8c60, State: Initialized, Role: FOLLOWER
I20260812 09:51:02.163261 20967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:02.163406 20967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:51:02.163492 20967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:51:02.163597 20967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:02.164589 20967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:02.164958 20967 leader_election.cc:302] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 483bbdd57fec41a68cd023ed9e0b8c60; no voters:
I20260812 09:51:02.165318 20967 leader_election.cc:288] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:51:02.165445 20972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:51:02.165702 20972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 LEADER]: Becoming Leader. State: Replica: 483bbdd57fec41a68cd023ed9e0b8c60, State: Running, Role: LEADER
I20260812 09:51:02.166076 20972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:02.166777 20967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:51:02.168105 20974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 483bbdd57fec41a68cd023ed9e0b8c60. Latest consensus state: current_term: 1 leader_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } } }
I20260812 09:51:02.168262 20974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:02.168726 20981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:51:02.168681 20973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } } }
I20260812 09:51:02.168830 20973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:02.169248 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.154339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48516 (local address 127.11.118.190:45543)
0812 09:51:02.154837 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:02.154853 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:02.154896 (+ 43us) server_negotiation.cc:407] Connection header received
0812 09:51:02.155697 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:02.155718 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:02.156080 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:02.156460 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:02.157363 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.158400 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.159359 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.159869 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.160052 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.163107 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:02.163114 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:02.163155 (+ 41us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:02.163194 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:02.165215 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.165881 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.165888 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.165894 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.166045 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.166388 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.166391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.166393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.167004 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:02.167357 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:02.167663 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 09:51:02.168069 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":152,"threads_started":1}
I20260812 09:51:02.172307 20981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:51:02.179296 20981 catalog_manager.cc:1347] Generated new cluster ID: 298f5663adff42ee9df539cc38d5b742
I20260812 09:51:02.179409 20981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:51:02.187041 20981 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:51:02.188642 20981 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:51:02.197677 20981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Generated new TSK 0
I20260812 09:51:02.198650 20981 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:51:02.243755 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:02.369753 20995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:02.370092 20995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:02.370141 20995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:02.374599 20995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:02.374692 20995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:02.374792 20995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:51:02.381163 20995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:02.382524 20995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:02.383653 20995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:02.394173 21003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.394173 21001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.394181 21000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:02.394573 20995 server_base.cc:1034] running on GCE node
I20260812 09:51:02.395107 20995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:02.395769 20995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:02.396944 20995 hybrid_clock.cc:648] HybridClock initialized: now 1786528262396929 us; error 30 us; skew 500 ppm
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:02.400024 20995 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:51:02.400955 20995 webserver.cc:460] Webserver started at http://127.11.118.129:46005/ using document root <none> and password file <none>
I20260812 09:51:02.401522 20995 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:02.401584 20995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:02.401823 20995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:02.404098 20995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "47d725e6eb644e5e8058a6a48bdc0f09"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "1876fa5769870e122ab271022740b448"
server_key_iv: "f535ec79dbc4ed5aad73e86ec7c24925"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.404686 20995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "47d725e6eb644e5e8058a6a48bdc0f09"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "1876fa5769870e122ab271022740b448"
server_key_iv: "f535ec79dbc4ed5aad73e86ec7c24925"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.408730 20995 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:51:02.411588 21011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.413028 20995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:02.413164 20995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "47d725e6eb644e5e8058a6a48bdc0f09"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "1876fa5769870e122ab271022740b448"
server_key_iv: "f535ec79dbc4ed5aad73e86ec7c24925"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.413331 20995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:02.433686 20995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:02.437330 20995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:02.437557 20995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:02.438205 20995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:02.439185 20995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:02.439257 20995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.439349 20995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:02.439395 20995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.449227 20995 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:45225
I20260812 09:51:02.449245 21133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:45225 every 8 connection(s)
I20260812 09:51:02.450215 20995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:51:02.452751 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 20995
I20260812 09:51:02.452899 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:51:02.453277 11738 external_mini_cluster.cc:1428] Setting key 325cd07d43ad243800985b280d6a9e62
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:51:02.466609 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.452235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:40641 (local address 127.11.118.190:45543)
0812 09:51:02.452397 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:02.452401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:02.453710 (+ 1309us) server_negotiation.cc:407] Connection header received
0812 09:51:02.454704 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:02.454708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:02.454769 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:02.454861 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:02.456629 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.457397 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.458584 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.458863 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.459003 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.462073 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:02.462077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:02.462079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:02.462108 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:02.463860 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.464663 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.464667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.464668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.464769 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.465272 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.465275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.465277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.465503 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:02.465599 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:02.466150 (+ 551us) server_negotiation.cc:299] Negotiation successful
0812 09:51:02.466401 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:51:02.467505 21136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.452618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:40641)
0812 09:51:02.453493 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:02.453558 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:02.454473 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:02.455146 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:02.455156 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:02.455713 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:02.456443 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.456466 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.457553 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.457556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.458471 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.458481 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.459061 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.459065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.459245 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.459954 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:02.459972 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:02.461820 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:02.464015 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.464024 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.464047 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.464511 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.464874 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.464878 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.464880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.465111 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.465616 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:02.465622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:02.465912 (+ 290us) client_negotiation.cc:769] Sending connection context
0812 09:51:02.466089 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 09:51:02.466493 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":147,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:51:02.469158 21134 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45543
I20260812 09:51:02.469465 21134 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:02.470043 21134 heartbeater.cc:511] Master 127.11.118.190:45543 requested a full tablet report, sending...
I20260812 09:51:02.471889 20927 ts_manager.cc:194] Registered new tserver with Master: 47d725e6eb644e5e8058a6a48bdc0f09 (127.11.118.129:45225)
I20260812 09:51:02.473376 20927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:40641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:51:02.490715 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:02.612564 21140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:02.612860 21140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:02.612906 21140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:02.617419 21140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:02.617506 21140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:02.617568 21140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:51:02.623234 21140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:02.624334 21140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:02.625340 21140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:02.635605 21145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.635639 21148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.635605 21146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:02.635967 21140 server_base.cc:1034] running on GCE node
I20260812 09:51:02.636521 21140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:02.637194 21140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:02.638365 21140 hybrid_clock.cc:648] HybridClock initialized: now 1786528262638348 us; error 30 us; skew 500 ppm
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:02.641480 21140 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:51:02.642429 21140 webserver.cc:460] Webserver started at http://127.11.118.130:34015/ using document root <none> and password file <none>
I20260812 09:51:02.643055 21140 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:02.643132 21140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:02.643321 21140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:02.645408 21140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "4b6d8ef326684da08abd338c99d69355"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "bea99899e5ca81dd08038d3345255688"
server_key_iv: "c30d42ed59c3a87ea63c50f1a43f101c"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.645982 21140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "4b6d8ef326684da08abd338c99d69355"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "bea99899e5ca81dd08038d3345255688"
server_key_iv: "c30d42ed59c3a87ea63c50f1a43f101c"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.649997 21140 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260812 09:51:02.652673 21156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.653990 21140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 09:51:02.654140 21140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "4b6d8ef326684da08abd338c99d69355"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "bea99899e5ca81dd08038d3345255688"
server_key_iv: "c30d42ed59c3a87ea63c50f1a43f101c"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.654268 21140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:02.673187 21140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:02.676792 21140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:02.677032 21140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:02.677698 21140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:02.678591 21140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:02.678638 21140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.678709 21140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:02.678742 21140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.688436 21140 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:35181
I20260812 09:51:02.688508 21280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:35181 every 8 connection(s)
I20260812 09:51:02.689493 21140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:51:02.699517 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21140
I20260812 09:51:02.699648 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:51:02.700001 11738 external_mini_cluster.cc:1428] Setting key 9483b2b3cfe0abf72229a7196f0f7ca2
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:02.708142 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.691543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:42689 (local address 127.11.118.190:45543)
0812 09:51:02.691725 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:02.691729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:02.692840 (+ 1111us) server_negotiation.cc:407] Connection header received
0812 09:51:02.693730 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:02.693735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:02.693786 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:02.693872 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:02.695506 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.696164 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.698399 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.698660 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.698792 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.702304 (+ 3512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:02.702312 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:02.702316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:02.702358 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:02.705011 (+ 2653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.705846 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.705853 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.705858 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.705981 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.706527 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.706530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.706531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.706739 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:02.706801 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:02.707805 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0812 09:51:02.707953 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 09:51:02.709300 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.691938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:42689)
0812 09:51:02.692673 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:02.692717 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:02.693511 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:02.694062 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:02.694083 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:02.694650 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:02.695296 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.695313 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.696355 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.696359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.698205 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.698234 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.698867 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.698872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.699156 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.700013 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:02.700043 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:02.702063 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:02.705264 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.705272 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.705290 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.705682 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.706117 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.706123 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.706129 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.706379 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.706919 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:02.706927 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:02.707414 (+ 487us) client_negotiation.cc:769] Sending connection context
0812 09:51:02.707673 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 09:51:02.708101 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":117,"threads_started":1}
I20260812 09:51:02.710893 21281 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45543
I20260812 09:51:02.711264 21281 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:02.712021 21281 heartbeater.cc:511] Master 127.11.118.190:45543 requested a full tablet report, sending...
I20260812 09:51:02.713581 20927 ts_manager.cc:194] Registered new tserver with Master: 4b6d8ef326684da08abd338c99d69355 (127.11.118.130:35181)
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:51:02.714649 20927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:42689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:51:02.740181 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:02.870519 21287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:02.870853 21287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:02.870904 21287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:02.875284 21287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:02.875373 21287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:02.875437 21287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:51:02.881219 21287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:02.882467 21287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:02.883679 21287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:02.894554 21297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.894554 21292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:02.894568 21295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:02.895083 21287 server_base.cc:1034] running on GCE node
I20260812 09:51:02.895551 21287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:02.896256 21287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:02.897456 21287 hybrid_clock.cc:648] HybridClock initialized: now 1786528262897439 us; error 39 us; skew 500 ppm
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:02.900862 21287 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:51:02.901873 21287 webserver.cc:460] Webserver started at http://127.11.118.131:37307/ using document root <none> and password file <none>
I20260812 09:51:02.902474 21287 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:02.902544 21287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:02.902734 21287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:02.905393 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "1562f05eea5f413b9bfdf561bd40b600"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "dc3b8826923062918016f0db02f5e4f7"
server_key_iv: "794e48648635508dbc691696a24f00f7"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.906299 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "1562f05eea5f413b9bfdf561bd40b600"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "dc3b8826923062918016f0db02f5e4f7"
server_key_iv: "794e48648635508dbc691696a24f00f7"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.910563 21287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:51:02.913460 21304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.915201 21287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:02.915378 21287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "1562f05eea5f413b9bfdf561bd40b600"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "dc3b8826923062918016f0db02f5e4f7"
server_key_iv: "794e48648635508dbc691696a24f00f7"
server_key_version: "encryptionkey@0"
I20260812 09:51:02.915516 21287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:02.936537 21287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:02.940353 21287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:02.940608 21287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:02.941288 21287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:02.942203 21287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:02.942273 21287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.942356 21287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:02.942404 21287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:02.952854 21287 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:38811
I20260812 09:51:02.952872 21429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:38811 every 8 connection(s)
I20260812 09:51:02.953887 21287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:51:02.959537 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21287
I20260812 09:51:02.959705 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:51:02.960050 11738 external_mini_cluster.cc:1428] Setting key f611a20cb81a48bbaa3cdaf128dfcedd
Aug 12 09:51:02 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528262, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:02.970834 20970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.956220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:37559 (local address 127.11.118.190:45543)
0812 09:51:02.956405 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:02.956410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:02.957648 (+ 1238us) server_negotiation.cc:407] Connection header received
0812 09:51:02.958684 (+ 1036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:02.958688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:02.958751 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:02.958858 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:02.960708 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.961414 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.962954 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.963227 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.963339 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.966346 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:02.966349 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:02.966352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:02.966386 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:02.968104 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.968890 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.968894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.968896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.968990 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:02.969473 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:02.969476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:02.969477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:02.969706 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:02.969882 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:02.970517 (+ 635us) server_negotiation.cc:299] Negotiation successful
0812 09:51:02.970653 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 09:51:02.971746 21432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:02.956591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:37559)
0812 09:51:02.957459 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:02.957508 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:02.958456 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:02.959169 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:02.959181 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:02.959779 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:02.960536 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.960555 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.961586 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.961589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.962813 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:02.962824 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:02.963405 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:02.963409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:02.963604 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:02.964277 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:02.964296 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:02.966075 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:02.968397 (+ 2322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.968404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.968446 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.968769 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.969119 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:02.969123 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:02.969124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:02.969343 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:02.969919 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:02.969926 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:02.970216 (+ 290us) client_negotiation.cc:769] Sending connection context
0812 09:51:02.970420 (+ 204us) client_negotiation.cc:240] Negotiation successful
0812 09:51:02.970728 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":210,"threads_started":1}
I20260812 09:51:02.973376 21430 heartbeater.cc:347] Connected to a master server at 127.11.118.190:45543
I20260812 09:51:02.973682 21430 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:02.974434 21430 heartbeater.cc:511] Master 127.11.118.190:45543 requested a full tablet report, sending...
I20260812 09:51:02.975678 20927 ts_manager.cc:194] Registered new tserver with Master: 1562f05eea5f413b9bfdf561bd40b600 (127.11.118.131:38811)
I20260812 09:51:02.976418 20927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:37559
I20260812 09:51:02.987666 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
Entry for principal oryx/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab.
WARNING: no policy specified for oryx/127.11.118.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
Entry for principal oryx/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab.
WARNING: no policy specified for oryx/127.11.118.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
Entry for principal oryx/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab.
I20260812 09:51:03.086421 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20995
I20260812 09:51:03.096925 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21140
I20260812 09:51:03.105849 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21287
I20260812 09:51:03.114897 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 20892
I20260812 09:51:03.124694 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45543
--webserver_interface=127.11.118.190
--webserver_port=34871
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:03.246006 21442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:03.246337 21442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:03.246381 21442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:03.250701 21442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:03.250792 21442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:03.250813 21442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:03.250836 21442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:03.250851 21442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:03.256778 21442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=34871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:03.258033 21442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:03.259169 21442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:03.268381 21450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:03.268430 21447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:03.268388 21448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.268712 21442 server_base.cc:1034] running on GCE node
I20260812 09:51:03.269464 21442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:03.270663 21442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:03.271867 21442 hybrid_clock.cc:648] HybridClock initialized: now 1786528263271824 us; error 61 us; skew 500 ppm
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528263, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:03.275029 21442 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:51:03.276153 21442 webserver.cc:460] Webserver started at http://127.11.118.190:34871/ using document root <none> and password file <none>
I20260812 09:51:03.276867 21442 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:03.276973 21442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:03.281661 21442 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:51:03.284444 21457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.285971 21442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:03.286108 21442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "483bbdd57fec41a68cd023ed9e0b8c60"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "607d23cf43b497c8470fbca607e08e56"
server_key_iv: "ba70d1869943cd050553edf08540488d"
server_key_version: "encryptionkey@0"
I20260812 09:51:03.286720 21442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:03.313086 21442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:03.316449 21442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:03.316640 21442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:03.324839 21442 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:45543
I20260812 09:51:03.324867 21517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:45543 every 8 connection(s)
I20260812 09:51:03.326056 21442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:51:03.330605 21518 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:51:03.332582 21518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Bootstrap starting.
I20260812 09:51:03.333479 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21442
I20260812 09:51:03.333993 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:45225
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:45543
--webserver_port=46005
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:51:03.351673 21518 log.cc:824] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:03.358880 21518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:51:03.359511 21518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Bootstrap complete.
I20260812 09:51:03.364295 21518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:03.364771 21518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483bbdd57fec41a68cd023ed9e0b8c60, State: Initialized, Role: FOLLOWER
I20260812 09:51:03.365335 21518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:03.365489 21518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:51:03.365577 21518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:51:03.365693 21518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:51:03.368052 21518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:03.368434 21518 leader_election.cc:302] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 483bbdd57fec41a68cd023ed9e0b8c60; no voters:
I20260812 09:51:03.368769 21518 leader_election.cc:288] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 09:51:03.368935 21523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 09:51:03.369400 21523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [term 2 LEADER]: Becoming Leader. State: Replica: 483bbdd57fec41a68cd023ed9e0b8c60, State: Running, Role: LEADER
I20260812 09:51:03.369766 21523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } }
I20260812 09:51:03.370127 21518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:51:03.371364 21524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } } }
I20260812 09:51:03.371520 21524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:03.372165 21525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 483bbdd57fec41a68cd023ed9e0b8c60. Latest consensus state: current_term: 2 leader_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "483bbdd57fec41a68cd023ed9e0b8c60" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45543 } } }
I20260812 09:51:03.372283 21525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:03.375943 21544 catalog_manager.cc:1259] Loaded cluster ID: 298f5663adff42ee9df539cc38d5b742
I20260812 09:51:03.376065 21544 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: loading cluster ID for follower catalog manager: success
I20260812 09:51:03.379701 21544 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: acquiring CA information for follower catalog manager: success
I20260812 09:51:03.381285 21544 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:51:03.381449 21534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:51:03.382326 21534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:51:03.382761 21534 catalog_manager.cc:1259] Loaded cluster ID: 298f5663adff42ee9df539cc38d5b742
I20260812 09:51:03.382820 21534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:51:03.383476 21534 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:51:03.383983 21534 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 483bbdd57fec41a68cd023ed9e0b8c60: Loaded TSK: 0
I20260812 09:51:03.384774 21534 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:51:03.461187 21521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:03.461462 21521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:03.461508 21521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:03.466192 21521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:03.466271 21521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:03.466336 21521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:51:03.472476 21521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.129.keytab
--principal=oryx/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:45225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=46005
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:03.473644 21521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:03.475138 21521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:03.486027 21550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:03.486038 21551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.486086 21521 server_base.cc:1034] running on GCE node
W20260812 09:51:03.486191 21554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.486822 21521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:03.487666 21521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:03.488859 21521 hybrid_clock.cc:648] HybridClock initialized: now 1786528263488825 us; error 58 us; skew 500 ppm
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528263, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:03.492110 21521 init.cc:377] Logged in from keytab as oryx/127.11.118.129@KRBTEST.COM (short username oryx)
I20260812 09:51:03.493224 21521 webserver.cc:460] Webserver started at http://127.11.118.129:46005/ using document root <none> and password file <none>
I20260812 09:51:03.493861 21521 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:03.493956 21521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:03.498571 21521 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:03.500972 21563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.502544 21521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:03.502689 21521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "47d725e6eb644e5e8058a6a48bdc0f09"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "1876fa5769870e122ab271022740b448"
server_key_iv: "f535ec79dbc4ed5aad73e86ec7c24925"
server_key_version: "encryptionkey@0"
I20260812 09:51:03.503455 21521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:03.535261 21521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:03.539834 21521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:03.540081 21521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:03.540740 21521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:03.541700 21521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:03.541759 21521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.541805 21521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:03.541819 21521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.551841 21521 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:45225
I20260812 09:51:03.551903 21688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:45225 every 8 connection(s)
I20260812 09:51:03.553023 21521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:51:03.563023 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21521
I20260812 09:51:03.563666 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:35181
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:45543
--webserver_port=34015
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 09:51:03.568564 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.555524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:45585 (local address 127.11.118.190:45543)
0812 09:51:03.557688 (+ 2164us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.557703 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.557737 (+ 34us) server_negotiation.cc:407] Connection header received
0812 09:51:03.557958 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.557967 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.558248 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.558510 (+ 262us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.559809 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.560790 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.562159 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.562669 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.562809 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.567661 (+ 4852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:45585: BlockingRecv error: recv got EOF from 127.11.118.129:45585 (error 108)
Metrics: {"server-negotiator.queue_time_us":2012,"thread_start_us":185,"threads_started":1}
I20260812 09:51:03.568591 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.555576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:45585)
0812 09:51:03.556412 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.556461 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.557257 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.558648 (+ 1391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.558656 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.559134 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.559623 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.559638 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.560991 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.560993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.561974 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.561985 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.562884 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.562890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.563133 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.564071 (+ 938us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.564096 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.567403 (+ 3307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":161,"threads_started":1}
W20260812 09:51:03.569501 21689 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:45543 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.118.190:45543: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:03.577301 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.570053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:33921)
0812 09:51:03.570247 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.570269 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.570438 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.570740 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.570746 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.571030 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.571230 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.571242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.572205 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.572210 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.573265 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.573282 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.573819 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.573823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.573954 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.574512 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.574534 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.577083 (+ 2549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85}
W20260812 09:51:03.577348 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.570115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:33921 (local address 127.11.118.190:45543)
0812 09:51:03.570235 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.570239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.570348 (+ 109us) server_negotiation.cc:407] Connection header received
0812 09:51:03.570546 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.570549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.570595 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.570667 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.571406 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.572048 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.573450 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.573682 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.573774 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.577245 (+ 3471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:33921: BlockingRecv error: recv got EOF from 127.11.118.129:33921 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:03.584813 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.578216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:57733)
0812 09:51:03.578385 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.578403 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.578498 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.578879 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.578881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.579139 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.579234 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.579256 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.580349 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.580352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.580971 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.580981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.581595 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.581598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.581668 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.582241 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.582254 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.584582 (+ 2328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 09:51:03.584957 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.578299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:57733 (local address 127.11.118.190:45543)
0812 09:51:03.578435 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.578439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.578457 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:51:03.578595 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.578598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.578649 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.578739 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.579384 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.580217 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.581090 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.581466 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.581570 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.584804 (+ 3234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:57733: BlockingRecv error: recv got EOF from 127.11.118.129:57733 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 09:51:03.585376 21689 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:51:03.688463 21694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:03.688771 21694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:03.688825 21694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:03.693254 21694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:03.693341 21694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:03.693457 21694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:51:03.699540 21694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.130.keytab
--principal=oryx/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:35181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=34015
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:03.700686 21694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:03.701709 21694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:03.712802 21702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.712781 21694 server_base.cc:1034] running on GCE node
W20260812 09:51:03.712779 21705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:03.712800 21701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.713547 21694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:03.714224 21694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:03.715474 21694 hybrid_clock.cc:648] HybridClock initialized: now 1786528263715444 us; error 44 us; skew 500 ppm
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528263, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:03.719228 21694 init.cc:377] Logged in from keytab as oryx/127.11.118.130@KRBTEST.COM (short username oryx)
I20260812 09:51:03.720458 21694 webserver.cc:460] Webserver started at http://127.11.118.130:34015/ using document root <none> and password file <none>
I20260812 09:51:03.721112 21694 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:03.721236 21694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:03.726580 21694 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:51:03.729375 21714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.730939 21694 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:03.731199 21694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "4b6d8ef326684da08abd338c99d69355"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "bea99899e5ca81dd08038d3345255688"
server_key_iv: "c30d42ed59c3a87ea63c50f1a43f101c"
server_key_version: "encryptionkey@0"
I20260812 09:51:03.731859 21694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:03.750224 21694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:03.753947 21694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:03.754184 21694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:03.754863 21694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:03.755813 21694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:03.755883 21694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.755957 21694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:03.755997 21694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.766106 21694 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:35181
I20260812 09:51:03.766127 21835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:35181 every 8 connection(s)
I20260812 09:51:03.767249 21694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:51:03.773362 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21694
I20260812 09:51:03.773891 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:38811
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:45543
--webserver_port=37307
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 09:51:03.782683 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.769357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:44265 (local address 127.11.118.190:45543)
0812 09:51:03.769526 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.769530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.770862 (+ 1332us) server_negotiation.cc:407] Connection header received
0812 09:51:03.771970 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.771974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.772041 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.772145 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.773629 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.774370 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.776476 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.776946 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.777088 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.782546 (+ 5458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:44265: BlockingRecv error: recv got EOF from 127.11.118.130:44265 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 09:51:03.783455 21838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.769765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:44265)
0812 09:51:03.770682 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.770732 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.771741 (+ 1009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.772339 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.772346 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.772744 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.773406 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.773430 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.774528 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.774535 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.776282 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.776298 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.777129 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.777132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.777289 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.778014 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.778041 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.782396 (+ 4355us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":130,"threads_started":1}
W20260812 09:51:03.784096 21836 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:45543 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.118.190:45543: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:03.791563 21838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.784677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:58705)
0812 09:51:03.784961 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.784977 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.785086 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.785537 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.785540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.785705 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.785823 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.785828 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.787122 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.787125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.787724 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.787735 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.788447 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.788450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.788528 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.789094 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.789107 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.791384 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216}
W20260812 09:51:03.791672 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.784823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58705 (local address 127.11.118.190:45543)
0812 09:51:03.784953 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.784957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.785027 (+ 70us) server_negotiation.cc:407] Connection header received
0812 09:51:03.785283 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.785289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.785367 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.785530 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.786009 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.786949 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.787861 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.788287 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.788444 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.791542 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:58705: BlockingRecv error: recv got EOF from 127.11.118.130:58705 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:03.798514 21838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.792355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:55799)
0812 09:51:03.792520 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.792536 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.792654 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.792964 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.792967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.793168 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.793273 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.793279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.794098 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.794102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.795027 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.795038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.795549 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.795553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:03.795641 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.796164 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:03.796186 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:03.798397 (+ 2211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":71}
W20260812 09:51:03.798751 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.792415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:55799 (local address 127.11.118.190:45543)
0812 09:51:03.792544 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.792547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.792588 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:51:03.792797 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.792800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.792846 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.792919 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.793406 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.793978 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.795167 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.795427 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:03.795523 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:03.798626 (+ 3103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:55799: BlockingRecv error: recv got EOF from 127.11.118.130:55799 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 09:51:03.798918 21836 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:51:03.904233 21839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:03.904569 21839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:03.904618 21839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:03.909309 21839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:03.909401 21839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:03.909468 21839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:51:03.915926 21839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/krb5kdc/oryx_127.11.118.131.keytab
--principal=oryx/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:38811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=37307
--tserver_master_addrs=127.11.118.190:45543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:03.917143 21839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:03.918231 21839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:03.929956 21846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:03.930107 21848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.930158 21839 server_base.cc:1034] running on GCE node
W20260812 09:51:03.930107 21845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:03.930950 21839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:03.931751 21839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:03.932973 21839 hybrid_clock.cc:648] HybridClock initialized: now 1786528263932953 us; error 35 us; skew 500 ppm
Aug 12 09:51:03 dist-test-slave-2w3w krb5kdc[20878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528263, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:03.936957 21839 init.cc:377] Logged in from keytab as oryx/127.11.118.131@KRBTEST.COM (short username oryx)
I20260812 09:51:03.938076 21839 webserver.cc:460] Webserver started at http://127.11.118.131:37307/ using document root <none> and password file <none>
I20260812 09:51:03.938745 21839 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:03.938879 21839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:03.943598 21839 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:51:03.946261 21858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.948026 21839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:03.948235 21839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "1562f05eea5f413b9bfdf561bd40b600"
format_stamp: "Formatted at 2026-08-12 09:51:02 on dist-test-slave-2w3w"
server_key: "dc3b8826923062918016f0db02f5e4f7"
server_key_iv: "794e48648635508dbc691696a24f00f7"
server_key_version: "encryptionkey@0"
I20260812 09:51:03.948982 21839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:03.972604 21839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:03.977000 21839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:03.977246 21839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:03.977946 21839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:03.978891 21839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:03.978969 21839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.979091 21839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:03.979136 21839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:03.990511 21839 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:38811
I20260812 09:51:03.990530 21983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:38811 every 8 connection(s)
I20260812 09:51:03.991839 21839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:51:03.995303 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 21839
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
W20260812 09:51:04.007443 21693 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:03.994082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:54531 (local address 127.11.118.190:45543)
0812 09:51:03.994291 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.994296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.996028 (+ 1732us) server_negotiation.cc:407] Connection header received
0812 09:51:03.997679 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.997684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.997747 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.997844 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.999536 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.000442 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.002159 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.002663 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.002825 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.007311 (+ 4486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:54531: BlockingRecv error: recv got EOF from 127.11.118.131:54531 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 09:51:04.007974 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.996658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48532 (local address 127.11.118.190:45543)
0812 09:51:03.997064 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:03.997069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:03.997090 (+ 21us) server_negotiation.cc:407] Connection header received
0812 09:51:03.997140 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:03.997143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:03.997197 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:03.997335 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:03.998382 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:03.999219 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.000646 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.000978 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.001090 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.003357 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:04.003366 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:04.003389 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:04.003427 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:04.005438 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:04.006028 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:04.006036 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:04.006047 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:04.006240 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:04.006538 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:04.006542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:04.006544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:04.006955 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:04.007235 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:04.007544 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 09:51:04.007832 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":104,"threads_started":1}
I20260812 09:51:04.008435 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:03.994301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:54531)
0812 09:51:03.995697 (+ 1396us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:03.995828 (+ 131us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:03.997388 (+ 1560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:03.998044 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:03.998053 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:03.998593 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:03.999376 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:03.999396 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.000618 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.000625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.002006 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.002019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.002922 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.002926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.003239 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.003999 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:04.004023 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:04.007179 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":991,"thread_start_us":164,"threads_started":1}
W20260812 09:51:04.008973 21984 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:45543 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.118.190:45543: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:04.015574 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:04.009465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:37485)
0812 09:51:04.009577 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:04.009594 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:04.009675 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:04.010034 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:04.010038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:04.010273 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:04.010414 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.010423 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.011458 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.011461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.012037 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.012047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.012616 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.012619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.012699 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.013239 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:04.013252 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:04.015454 (+ 2202us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260812 09:51:04.015820 21988 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:04.009525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:37485 (local address 127.11.118.190:45543)
0812 09:51:04.009639 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:04.009643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:04.009658 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:04.009745 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:04.009747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:04.009793 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:04.009876 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:04.010599 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.011344 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.012180 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.012480 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.012585 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.015679 (+ 3094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:37485: BlockingRecv error: recv got EOF from 127.11.118.131:37485 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:04.021801 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:04.016339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:45739)
0812 09:51:04.016443 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:04.016458 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:04.016541 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:04.016859 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:04.016861 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:04.017009 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:04.017095 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.017100 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.017938 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.017941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.018505 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.018514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.019103 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.019106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.019176 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.019726 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:04.019738 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:04.021663 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 09:51:04.022033 21988 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:04.016419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:45739 (local address 127.11.118.190:45543)
0812 09:51:04.016598 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:04.016602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:04.016618 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:51:04.016658 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:04.016660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:04.016698 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:04.016825 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:04.017222 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.017757 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.018626 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.018914 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.019086 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.021918 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:45739: BlockingRecv error: recv got EOF from 127.11.118.131:45739 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260812 09:51:04.022331 21984 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:04.598840 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:04.586140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:59749)
0812 09:51:04.586412 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:04.586428 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:04.586535 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:04.586867 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:04.586870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:04.587159 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:04.587310 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.587320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.588227 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.588230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.588826 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.588835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.589345 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.589348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.589419 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.595952 (+ 6533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:04.595970 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:04.598685 (+ 2715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":95,"threads_started":1}
W20260812 09:51:04.599108 21990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:04.586282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:59749 (local address 127.11.118.190:45543)
0812 09:51:04.586539 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:04.586542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:04.586556 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:51:04.586597 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:04.586599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:04.586642 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:04.586728 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:04.587454 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.588090 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.588954 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.589205 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.589305 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.598949 (+ 9644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:59749: BlockingRecv error: recv got EOF from 127.11.118.129:59749 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":77,"threads_started":1}
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:04 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:04.807356 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:04.800109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:53241)
0812 09:51:04.800580 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:04.800601 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:04.800762 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:04.801447 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:04.801450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:04.801695 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:04.801854 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.801862 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.802695 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.802700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.803456 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:04.803475 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.803964 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.803967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:04.804054 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.804665 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:04.804679 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:04.807067 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":102,"threads_started":1}
W20260812 09:51:04.807484 21990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:04.800228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:53241 (local address 127.11.118.190:45543)
0812 09:51:04.800446 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:04.800452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:04.800688 (+ 236us) server_negotiation.cc:407] Connection header received
0812 09:51:04.801145 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:04.801151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:04.801297 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:04.801410 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:04.801997 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.802566 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.803593 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:04.803831 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:04.803939 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:04.807219 (+ 3280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:53241: BlockingRecv error: recv got EOF from 127.11.118.130:53241 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:05.029064 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:05.023112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:39337)
0812 09:51:05.023414 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:05.023435 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:05.023542 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:05.023783 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:05.023785 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:05.023986 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:05.024086 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.024092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.024849 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.024851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.025419 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.025434 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.025853 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.025856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.025919 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.026526 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:05.026538 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:05.028920 (+ 2382us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":117,"threads_started":1}
W20260812 09:51:05.029260 21990 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:05.023261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:39337 (local address 127.11.118.190:45543)
0812 09:51:05.023418 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:05.023423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:05.023552 (+ 129us) server_negotiation.cc:407] Connection header received
0812 09:51:05.023612 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:05.023614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:05.023666 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:05.023753 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:05.024201 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.024752 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.025529 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.025751 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.025835 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.029123 (+ 3288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:39337: BlockingRecv error: recv got EOF from 127.11.118.131:39337 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:05.606873 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:05.599927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:54555)
0812 09:51:05.600230 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:05.600250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:05.600363 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:05.600654 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:05.600656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:05.600877 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:05.600983 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.600990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.602010 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.602013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.602864 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.602879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.603506 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.603510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.603586 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.604312 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:05.604326 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:05.606693 (+ 2367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":102,"threads_started":1}
W20260812 09:51:05.607331 21994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:05.600029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54555 (local address 127.11.118.190:45543)
0812 09:51:05.600363 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:05.600367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:05.600384 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:51:05.600433 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:05.600435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:05.600487 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:05.600579 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:05.601258 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.601846 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.603053 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.603309 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.603407 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.607199 (+ 3792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:54555: BlockingRecv error: recv got EOF from 127.11.118.129:54555 (error 108)
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":154,"threads_started":1}
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:05 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:05.815299 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:05.808376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:52955)
0812 09:51:05.808683 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:05.808698 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:05.808847 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:05.809173 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:05.809175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:05.809388 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:05.809493 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.809498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.810517 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.810520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.811221 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:05.811232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.811727 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.811730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:05.811803 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.812454 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:05.812468 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:05.815137 (+ 2669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":105,"threads_started":1}
W20260812 09:51:05.815531 21994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:05.808542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:52955 (local address 127.11.118.190:45543)
0812 09:51:05.808699 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:05.808703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:05.808775 (+ 72us) server_negotiation.cc:407] Connection header received
0812 09:51:05.808965 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:05.808968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:05.809017 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:05.809097 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:05.809679 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.810372 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.811355 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:05.811588 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:05.811702 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:05.815382 (+ 3680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:52955: BlockingRecv error: recv got EOF from 127.11.118.130:52955 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:06.036237 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:06.030051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:49799)
0812 09:51:06.030370 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:06.030384 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:06.030504 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:06.030787 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:06.030790 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:06.031055 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:06.031156 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.031162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.031940 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.031946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.032529 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.032538 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.033027 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.033030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.033122 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.033708 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:06.033721 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:06.035982 (+ 2261us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":121,"threads_started":1}
W20260812 09:51:06.036276 21994 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:06.030407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:49799 (local address 127.11.118.190:45543)
0812 09:51:06.030560 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:06.030564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:06.030579 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:06.030625 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:06.030627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:06.030667 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:06.030758 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:06.031283 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.031825 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.032657 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.032896 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.033015 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.036160 (+ 3145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:49799: BlockingRecv error: recv got EOF from 127.11.118.131:49799 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:06.613878 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:06.607837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:34499)
0812 09:51:06.608138 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:06.608153 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:06.608258 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:06.608570 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:06.608573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:06.608767 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:06.608925 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.608931 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.609834 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.609837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.610509 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.610519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.611242 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.611244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.611316 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.611869 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:06.611881 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:06.613746 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
W20260812 09:51:06.614131 22001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:06.607995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:34499 (local address 127.11.118.190:45543)
0812 09:51:06.608241 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:06.608244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:06.608259 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:06.608328 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:06.608330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:06.608394 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:06.608486 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:06.609106 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.609676 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.610647 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.610942 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.611236 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.613988 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:34499: BlockingRecv error: recv got EOF from 127.11.118.129:34499 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":102,"threads_started":1}
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:06 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:06.822482 22002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:06.816243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:54187)
0812 09:51:06.816541 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:06.816554 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:06.816652 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:06.816887 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:06.816889 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:06.817081 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:06.817184 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.817189 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.818207 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.818211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.818816 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:06.818826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.819583 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.819587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:06.819665 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.820274 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:06.820287 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:06.822347 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":128,"threads_started":1}
W20260812 09:51:06.822728 22001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:06.816307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:54187 (local address 127.11.118.190:45543)
0812 09:51:06.816488 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:06.816492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:06.816626 (+ 134us) server_negotiation.cc:407] Connection header received
0812 09:51:06.816733 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:06.816735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:06.816779 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:06.816853 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:06.817307 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.817990 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.819011 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:06.819440 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:06.819540 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:06.822591 (+ 3051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:54187: BlockingRecv error: recv got EOF from 127.11.118.130:54187 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:07.043671 22003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:07.037262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:58547)
0812 09:51:07.037572 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:07.037587 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:07.037728 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:07.038047 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:07.038049 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:07.038278 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:07.038408 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.038414 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.039268 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.039272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.039876 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.039885 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.040538 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.040542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.040636 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.041304 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:07.041317 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:07.043542 (+ 2225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":92,"threads_started":1}
W20260812 09:51:07.044116 22001 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:07.037368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:58547 (local address 127.11.118.190:45543)
0812 09:51:07.037527 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:07.037531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:07.037674 (+ 143us) server_negotiation.cc:407] Connection header received
0812 09:51:07.037875 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:07.037878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:07.037933 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:07.038021 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:07.038539 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.039156 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.040011 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.040366 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.040530 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.043745 (+ 3215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:58547: BlockingRecv error: recv got EOF from 127.11.118.131:58547 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:07.621207 22004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:07.614911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:54309)
0812 09:51:07.615266 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:07.615286 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:07.615411 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:07.615703 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:07.615706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:07.615921 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:07.616021 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.616027 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.616880 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.616883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.617456 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.617465 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.618047 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.618051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.618148 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.618794 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:07.618817 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:07.621017 (+ 2200us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":101,"threads_started":1}
W20260812 09:51:07.621301 22005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:07.615114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54309 (local address 127.11.118.190:45543)
0812 09:51:07.615445 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:07.615449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:07.615464 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:07.615506 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:07.615508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:07.615551 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:07.615636 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:07.616174 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.616740 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.617588 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.617842 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.617971 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.621171 (+ 3200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:54309: BlockingRecv error: recv got EOF from 127.11.118.129:54309 (error 108)
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":129,"threads_started":1}
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:07 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:07.829475 22006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:07.823563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:58521)
0812 09:51:07.823890 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:07.823904 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:07.824017 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:07.824267 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:07.824269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:07.824466 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:07.824568 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.824574 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.825418 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.825421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.826024 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:07.826033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.826562 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.826566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:07.826652 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.827324 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:07.827337 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:07.829292 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":123,"threads_started":1}
W20260812 09:51:07.829545 22005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:07.823661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58521 (local address 127.11.118.190:45543)
0812 09:51:07.823823 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:07.823828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:07.823984 (+ 156us) server_negotiation.cc:407] Connection header received
0812 09:51:07.824103 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:07.824105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:07.824155 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:07.824228 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:07.824681 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.825264 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.826174 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:07.826430 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:07.826550 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:07.829436 (+ 2886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:58521: BlockingRecv error: recv got EOF from 127.11.118.130:58521 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:08.051357 22009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:08.044731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:46875)
0812 09:51:08.045153 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:08.045171 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:08.045341 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:08.045654 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:08.045657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:08.045892 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:08.045992 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.045998 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.046798 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.046804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.047418 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.047427 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.047926 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.047930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.048018 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.048691 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:08.048704 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:08.051232 (+ 2528us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":150,"threads_started":1}
W20260812 09:51:08.051575 22005 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:08.044955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:46875 (local address 127.11.118.190:45543)
0812 09:51:08.045153 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:08.045159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:08.045278 (+ 119us) server_negotiation.cc:407] Connection header received
0812 09:51:08.045475 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:08.045478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:08.045535 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:08.045630 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:08.046125 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.046674 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.047548 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.047795 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.047914 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.051436 (+ 3522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:46875: BlockingRecv error: recv got EOF from 127.11.118.131:46875 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:08.628178 22012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:08.622193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:43251)
0812 09:51:08.622479 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:08.622505 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:08.622604 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:08.622951 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:08.622953 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:08.623171 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:08.623267 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.623272 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.624200 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.624203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.624781 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.624790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.625355 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.625358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.625430 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.626014 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:08.626033 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:08.628049 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":135,"threads_started":1}
W20260812 09:51:08.628489 22013 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:08.622258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:43251 (local address 127.11.118.190:45543)
0812 09:51:08.622518 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:08.622522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:08.622654 (+ 132us) server_negotiation.cc:407] Connection header received
0812 09:51:08.622705 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:08.622707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:08.622754 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:08.622856 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:08.623416 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.624002 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.624926 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.625179 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.625277 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.628339 (+ 3062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:43251: BlockingRecv error: recv got EOF from 127.11.118.129:43251 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:08 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:08.837026 22014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:08.830459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:33587)
0812 09:51:08.830769 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:08.830787 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:08.831125 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:08.831461 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:08.831464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:08.831665 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:08.831766 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.831771 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.832648 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.832651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.833239 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:08.833249 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.833803 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.833806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:08.833884 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.834431 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:08.834443 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:08.836845 (+ 2402us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":71,"threads_started":1}
W20260812 09:51:08.837252 22013 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:08.830668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:33587 (local address 127.11.118.190:45543)
0812 09:51:08.830880 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:08.830884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:08.831098 (+ 214us) server_negotiation.cc:407] Connection header received
0812 09:51:08.831211 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:08.831214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:08.831304 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:08.831390 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:08.831931 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.832497 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.833406 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:08.833646 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:08.833739 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:08.837116 (+ 3377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:33587: BlockingRecv error: recv got EOF from 127.11.118.130:33587 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:09.059973 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:09.052439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:59059)
0812 09:51:09.053134 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:09.053154 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:09.053322 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:09.053699 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:09.053828 (+ 129us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:09.054122 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:09.054261 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.054269 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.055258 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.055262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.056032 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.056042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.056540 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.056542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.056605 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.057396 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:09.057413 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:09.059846 (+ 2433us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":86,"threads_started":1}
W20260812 09:51:09.060179 22013 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:09.052542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:59059 (local address 127.11.118.190:45543)
0812 09:51:09.052712 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:09.052717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:09.053266 (+ 549us) server_negotiation.cc:407] Connection header received
0812 09:51:09.053437 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:09.053442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:09.053538 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:09.053634 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:09.054422 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.055110 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.056179 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.056417 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.056511 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.060029 (+ 3518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:59059: BlockingRecv error: recv got EOF from 127.11.118.131:59059 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:09.642758 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:09.629105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:38897)
0812 09:51:09.629395 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:09.629418 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:09.629516 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:09.629799 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:09.629801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:09.630028 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:09.630131 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.630136 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.631290 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.631293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.631874 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.631885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.632495 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.632499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.632590 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.640404 (+ 7814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:09.640423 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:09.642621 (+ 2198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
W20260812 09:51:09.643038 22017 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:09.629215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:38897 (local address 127.11.118.190:45543)
0812 09:51:09.629477 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:09.629481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:09.629498 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:51:09.629620 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:09.629622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:09.629669 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:09.629762 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:09.630295 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.631141 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.632037 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.632347 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.632474 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.642839 (+ 10365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:38897: BlockingRecv error: recv got EOF from 127.11.118.129:38897 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":101,"threads_started":1}
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:09 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:09.844326 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:09.837999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:34821)
0812 09:51:09.838345 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:09.838363 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:09.838540 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:09.838835 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:09.838838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:09.839121 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:09.839223 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.839229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.840034 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.840039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.840615 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:09.840623 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.841169 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.841173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:09.841265 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.842026 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:09.842041 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:09.844191 (+ 2150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":98,"threads_started":1}
W20260812 09:51:09.844631 22017 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:09.838110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:34821 (local address 127.11.118.190:45543)
0812 09:51:09.838329 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:09.838334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:09.838469 (+ 135us) server_negotiation.cc:407] Connection header received
0812 09:51:09.838649 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:09.838652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:09.838713 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:09.838810 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:09.839357 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.839907 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.840748 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:09.841057 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:09.841162 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:09.844399 (+ 3237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:34821: BlockingRecv error: recv got EOF from 127.11.118.130:34821 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:10.067257 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:10.061085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:59015)
0812 09:51:10.061547 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:10.061564 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:10.061695 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:10.062065 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:10.062068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:10.062301 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:10.062450 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.062458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.063252 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.063255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.063820 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.063828 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.064356 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.064359 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.064430 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.065031 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:10.065043 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:10.067130 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":86,"threads_started":1}
W20260812 09:51:10.067472 22017 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:10.061208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:59015 (local address 127.11.118.190:45543)
0812 09:51:10.061404 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:10.061408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:10.061655 (+ 247us) server_negotiation.cc:407] Connection header received
0812 09:51:10.061864 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:10.061869 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:10.061929 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:10.062034 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:10.062583 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.063153 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.063985 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.064216 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.064315 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.067317 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:59015: BlockingRecv error: recv got EOF from 127.11.118.131:59015 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:10.650494 22020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:10.643792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:59013)
0812 09:51:10.644237 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:10.644257 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:10.644399 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:10.644950 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:10.644953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:10.645189 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:10.645296 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.645302 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.646232 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.646235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.646850 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.646859 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.647455 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.647458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.647533 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.648130 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:10.648144 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:10.650277 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":120,"threads_started":1}
W20260812 09:51:10.650729 22021 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:10.643988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:59013 (local address 127.11.118.190:45543)
0812 09:51:10.644372 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:10.644376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:10.644393 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:51:10.644632 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:10.644635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:10.644724 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:10.644816 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:10.645474 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.646069 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.647066 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.647310 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.647440 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.650455 (+ 3015us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:59013: BlockingRecv error: recv got EOF from 127.11.118.129:59013 (error 108)
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":92,"threads_started":1}
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:10 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:10.852347 22022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:10.845329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:58107)
0812 09:51:10.845716 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:10.845730 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:10.845841 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:10.846100 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:10.846102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:10.846300 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:10.846395 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.846400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.847485 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.847487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.848258 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:10.848269 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.848861 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.848864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:10.848952 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.849540 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:10.849553 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:10.852210 (+ 2657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":152,"threads_started":1}
W20260812 09:51:10.852634 22021 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:10.845506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58107 (local address 127.11.118.190:45543)
0812 09:51:10.845671 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:10.845675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:10.845844 (+ 169us) server_negotiation.cc:407] Connection header received
0812 09:51:10.845926 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:10.845928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:10.845979 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:10.846091 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:10.846566 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.847331 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.848392 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:10.848726 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:10.848851 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:10.852510 (+ 3659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:58107: BlockingRecv error: recv got EOF from 127.11.118.130:58107 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:11.075757 22023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:11.068295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:40317)
0812 09:51:11.068786 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:11.068801 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:11.068970 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:11.069311 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:11.069314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:11.069614 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:11.069723 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.069748 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.070929 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.070932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.071809 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.071820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.072438 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.072441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.072515 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.073110 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:11.073123 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:11.075626 (+ 2503us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":226,"threads_started":1}
W20260812 09:51:11.076045 22021 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:11.068462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:40317 (local address 127.11.118.190:45543)
0812 09:51:11.068633 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:11.068638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:11.068926 (+ 288us) server_negotiation.cc:407] Connection header received
0812 09:51:11.069085 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:11.069089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:11.069150 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:11.069252 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:11.069954 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.070758 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.071963 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.072297 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.072402 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.075873 (+ 3471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:40317: BlockingRecv error: recv got EOF from 127.11.118.131:40317 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:11.660068 22024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:11.651769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:44025)
0812 09:51:11.652431 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:11.652448 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:11.652655 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:11.653047 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:11.653049 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:11.653265 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:11.653391 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.653396 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.654641 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.654644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.655390 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.655403 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.656023 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.656025 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.656285 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.657113 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:11.657129 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:11.659881 (+ 2752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":240,"threads_started":1}
W20260812 09:51:11.660256 22025 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:11.652104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:44025 (local address 127.11.118.190:45543)
0812 09:51:11.652533 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:11.652537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:11.652578 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:51:11.652778 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:11.652781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:11.652833 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:11.652965 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:11.653536 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.654436 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.655569 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.655879 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.655989 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.660104 (+ 4115us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:44025: BlockingRecv error: recv got EOF from 127.11.118.129:44025 (error 108)
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":221,"threads_started":1}
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:11 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:11.860260 22026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:11.853432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:39897)
0812 09:51:11.853735 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:11.853749 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:11.853858 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:11.854106 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:11.854108 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:11.854309 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:11.854522 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.854529 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.855630 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.855633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.856253 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:11.856263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.856900 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.856903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:11.856976 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.857572 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:11.857585 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:11.860087 (+ 2502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":113,"threads_started":1}
W20260812 09:51:11.860381 22025 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:11.853566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:39897 (local address 127.11.118.190:45543)
0812 09:51:11.853732 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:11.853736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:11.853863 (+ 127us) server_negotiation.cc:407] Connection header received
0812 09:51:11.853935 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:11.853938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:11.853985 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:11.854069 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:11.854678 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.855485 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.856505 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:11.856748 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:11.856884 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:11.860275 (+ 3391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:39897: BlockingRecv error: recv got EOF from 127.11.118.130:39897 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:12.083624 22027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:12.076963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:43559)
0812 09:51:12.077297 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:12.077318 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:12.077436 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:12.077800 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:12.077802 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:12.078021 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:12.078152 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.078159 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.079299 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.079302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.079911 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.079924 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.080455 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.080459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.080540 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.081324 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:12.081338 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:12.083478 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":134,"threads_started":1}
W20260812 09:51:12.083878 22025 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:12.077186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:43559 (local address 127.11.118.190:45543)
0812 09:51:12.077397 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:12.077401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:12.077419 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:51:12.077572 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:12.077575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:12.077630 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:12.077717 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:12.078317 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.078895 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.080060 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.080290 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.080388 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.083687 (+ 3299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:43559: BlockingRecv error: recv got EOF from 127.11.118.131:43559 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:12.667873 22028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:12.661282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:34503)
0812 09:51:12.661611 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:12.661630 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:12.661758 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:12.662056 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:12.662059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:12.662258 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:12.662360 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.662365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.663501 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.663504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.664156 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.664166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.664706 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.664709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.664792 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.665395 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:12.665407 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:12.667665 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":83,"threads_started":1}
W20260812 09:51:12.667961 22029 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:12.661476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:34503 (local address 127.11.118.190:45543)
0812 09:51:12.661754 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:12.661757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:12.661773 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:51:12.661829 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:12.661832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:12.661875 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:12.661961 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:12.662527 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.663352 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.664288 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.664543 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.664638 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.667823 (+ 3185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:34503: BlockingRecv error: recv got EOF from 127.11.118.129:34503 (error 108)
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":88,"threads_started":1}
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:12 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:12.867775 22030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:12.861370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:42075)
0812 09:51:12.861682 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:12.861696 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:12.861828 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:12.862130 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:12.862133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:12.862353 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:12.862459 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.862466 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.863317 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.863323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.863895 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:12.863904 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.864391 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.864396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:12.864492 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.865088 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:12.865102 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:12.867550 (+ 2448us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":115,"threads_started":1}
W20260812 09:51:12.867853 22029 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:12.861723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:42075 (local address 127.11.118.190:45543)
0812 09:51:12.861909 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:12.861915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:12.861930 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:12.861969 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:12.861971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:12.862010 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:12.862097 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:12.862588 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.863196 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.864026 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:12.864258 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:12.864364 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:12.867730 (+ 3366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:42075: BlockingRecv error: recv got EOF from 127.11.118.130:42075 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:13.090395 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:13.084532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:55983)
0812 09:51:13.084835 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:13.084849 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:13.084951 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:13.085203 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:13.085205 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:13.085401 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:13.085503 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.085508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.086329 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.086331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.086922 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.086932 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.087492 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.087495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.087569 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.088123 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:13.088136 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:13.090245 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":117,"threads_started":1}
W20260812 09:51:13.090649 22029 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:13.084618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:55983 (local address 127.11.118.190:45543)
0812 09:51:13.084778 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:13.084782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:13.084922 (+ 140us) server_negotiation.cc:407] Connection header received
0812 09:51:13.085032 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:13.085034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:13.085083 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:13.085157 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:13.085652 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.086208 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.087090 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.087326 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.087443 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.090473 (+ 3030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:55983: BlockingRecv error: recv got EOF from 127.11.118.131:55983 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:13.675707 22033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:13.669006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:49979)
0812 09:51:13.669298 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:13.669316 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:13.669418 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:13.669664 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:13.669666 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:13.669898 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:13.670090 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.670101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.670985 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.670988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.671720 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.671772 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.672334 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.672338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.672477 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.673095 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:13.673107 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:13.675564 (+ 2457us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":119,"threads_started":1}
W20260812 09:51:13.676003 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:13.669144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:49979 (local address 127.11.118.190:45543)
0812 09:51:13.669398 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:13.669401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:13.669416 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:13.669502 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:13.669504 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:13.669545 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:13.669627 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:13.670262 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.670837 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.671943 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.672189 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.672285 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.675830 (+ 3545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:49979: BlockingRecv error: recv got EOF from 127.11.118.129:49979 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:13 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:13.876390 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:13.868921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:42301)
0812 09:51:13.869239 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:13.869256 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:13.869373 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:13.869756 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:13.869766 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:13.870013 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:13.870220 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.870233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.871362 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.871366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.872082 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:13.872092 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.872724 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.872727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:13.872887 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.873697 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:13.873710 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:13.876245 (+ 2535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":144,"threads_started":1}
W20260812 09:51:13.876602 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:13.869071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:42301 (local address 127.11.118.190:45543)
0812 09:51:13.869230 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:13.869234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:13.869379 (+ 145us) server_negotiation.cc:407] Connection header received
0812 09:51:13.869482 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:13.869484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:13.869534 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:13.869611 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:13.870435 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.871179 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.872234 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:13.872594 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:13.872705 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:13.876457 (+ 3752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:42301: BlockingRecv error: recv got EOF from 127.11.118.130:42301 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:14.099213 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:14.091599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:48665)
0812 09:51:14.092168 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:14.092188 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:14.092403 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:14.092725 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:14.092728 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:14.093280 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:14.093432 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.093442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.094341 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.094346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.095090 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.095100 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.095612 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.095616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.095705 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.096384 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:14.096404 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:14.099016 (+ 2612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":167,"threads_started":1}
W20260812 09:51:14.099313 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:14.091795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:48665 (local address 127.11.118.190:45543)
0812 09:51:14.091970 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:14.091979 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:14.092329 (+ 350us) server_negotiation.cc:407] Connection header received
0812 09:51:14.092526 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:14.092531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:14.092594 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:14.092696 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:14.093576 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.094219 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.095221 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.095480 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.095606 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.099190 (+ 3584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:48665: BlockingRecv error: recv got EOF from 127.11.118.131:48665 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:14.688055 22038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:14.676646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:58475)
0812 09:51:14.677003 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:14.677017 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:14.677128 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:14.677409 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:14.677411 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:14.677612 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:14.677710 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.677716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.678562 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.678565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.679168 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.679177 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.679775 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.679778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.679861 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.685884 (+ 6023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:14.685900 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:14.687925 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":90,"threads_started":1}
W20260812 09:51:14.688366 22039 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:14.676778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:58475 (local address 127.11.118.190:45543)
0812 09:51:14.677122 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:14.677125 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:14.677140 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:14.677209 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:14.677211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:14.677253 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:14.677352 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:14.677878 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.678426 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.679327 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.679620 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.679736 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.688170 (+ 8434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:58475: BlockingRecv error: recv got EOF from 127.11.118.129:58475 (error 108)
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":132,"threads_started":1}
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:14 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:14.883337 22040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:14.877375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:40989)
0812 09:51:14.877694 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:14.877709 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:14.877832 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:14.878132 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:14.878134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:14.878342 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:14.878444 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.878449 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.879246 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.879249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.879824 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:14.879833 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.880303 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.880306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:14.880373 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.880939 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:14.880951 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:14.883179 (+ 2228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":130,"threads_started":1}
W20260812 09:51:14.883582 22039 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:14.877511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:40989 (local address 127.11.118.190:45543)
0812 09:51:14.877661 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:14.877665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:14.877839 (+ 174us) server_negotiation.cc:407] Connection header received
0812 09:51:14.877910 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:14.877912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:14.877956 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:14.878033 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:14.878561 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.879130 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.879952 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:14.880177 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:14.880265 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:14.883408 (+ 3143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:40989: BlockingRecv error: recv got EOF from 127.11.118.130:40989 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:15.106333 22041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:15.100288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:51379)
0812 09:51:15.100683 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:15.100700 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:15.100862 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:15.101158 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:15.101160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:15.101393 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:15.101489 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.101494 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.102367 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.102374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.102941 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.102949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.103465 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.103468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.103556 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.104139 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:15.104151 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:15.106187 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":127,"threads_started":1}
W20260812 09:51:15.106477 22039 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:15.100472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:51379 (local address 127.11.118.190:45543)
0812 09:51:15.100672 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:15.100677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:15.100801 (+ 124us) server_negotiation.cc:407] Connection header received
0812 09:51:15.100973 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:15.100977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:15.101032 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:15.101134 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:15.101611 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.102226 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.103092 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.103343 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.103456 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.106346 (+ 2890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:51379: BlockingRecv error: recv got EOF from 127.11.118.131:51379 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:15.695312 22042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:15.689158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:49125)
0812 09:51:15.689465 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:15.689479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:15.689572 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:15.689823 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:15.689825 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:15.690155 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:15.690261 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.690267 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.691245 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.691248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.691852 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.691861 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.692361 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.692363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.692443 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.693069 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:15.693081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:15.695183 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":108,"threads_started":1}
W20260812 09:51:15.695516 22043 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:15.689303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:49125 (local address 127.11.118.190:45543)
0812 09:51:15.689519 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:15.689523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:15.689536 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:51:15.689661 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:15.689663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:15.689707 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:15.689784 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:15.690407 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.691108 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.691977 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.692221 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.692342 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.695363 (+ 3021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:49125: BlockingRecv error: recv got EOF from 127.11.118.129:49125 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:15 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:15.890618 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:15.884270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:54693)
0812 09:51:15.884562 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:15.884576 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:15.884676 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:15.884937 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:15.884939 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:15.885160 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:15.885273 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.885280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.886108 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.886110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.886953 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:15.886994 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.887678 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.887683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:15.887781 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.888311 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:15.888325 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:15.890438 (+ 2113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":106,"threads_started":1}
W20260812 09:51:15.890782 22043 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:15.884353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:54693 (local address 127.11.118.190:45543)
0812 09:51:15.884517 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:15.884521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:15.884647 (+ 126us) server_negotiation.cc:407] Connection header received
0812 09:51:15.884743 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:15.884745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:15.884789 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:15.884871 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:15.885417 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.885971 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.887114 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:15.887547 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:15.887665 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:15.890614 (+ 2949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:54693: BlockingRecv error: recv got EOF from 127.11.118.130:54693 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:16.113957 22045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:16.107202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:33487)
0812 09:51:16.107726 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:16.107743 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:16.107957 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:16.108306 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:16.108308 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:16.108506 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:16.108610 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.108615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.109512 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.109515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.110257 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.110275 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.110864 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.110867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.110937 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.111522 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:16.111535 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:16.113787 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":262,"threads_started":1}
W20260812 09:51:16.114117 22043 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:16.107507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:33487 (local address 127.11.118.190:45543)
0812 09:51:16.107721 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:16.107726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:16.107884 (+ 158us) server_negotiation.cc:407] Connection header received
0812 09:51:16.108106 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:16.108108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:16.108158 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:16.108243 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:16.108746 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.109380 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.110403 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.110697 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.110805 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.113956 (+ 3151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:33487: BlockingRecv error: recv got EOF from 127.11.118.131:33487 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:16.703400 22046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:16.696361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:49903)
0812 09:51:16.696660 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:16.696675 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:16.696786 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:16.697131 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:16.697133 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:16.697556 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:16.697664 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.697671 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.698581 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.698584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.699442 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.699454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.700124 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.700128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.700216 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.700923 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:16.700942 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:16.703203 (+ 2261us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":110,"threads_started":1}
W20260812 09:51:16.703498 22047 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:16.696446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:49903 (local address 127.11.118.190:45543)
0812 09:51:16.696764 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:16.696768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:16.696787 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:51:16.696882 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:16.696885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:16.696933 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:16.697018 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:16.697874 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.698446 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.699600 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.699949 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.700067 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.703358 (+ 3291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:49903: BlockingRecv error: recv got EOF from 127.11.118.129:49903 (error 108)
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":143,"threads_started":1}
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:16 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:16.899142 22048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:16.891792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:34731)
0812 09:51:16.892146 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:16.892164 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:16.892276 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:16.892595 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:16.892597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:16.892802 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:16.892907 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.892912 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.893760 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.893763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.894384 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:16.894393 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.895493 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.895502 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:16.895581 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.896315 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:16.896328 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:16.898920 (+ 2592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":134,"threads_started":1}
W20260812 09:51:16.899204 22047 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:16.891976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:34731 (local address 127.11.118.190:45543)
0812 09:51:16.892138 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:16.892142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:16.892318 (+ 176us) server_negotiation.cc:407] Connection header received
0812 09:51:16.892393 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:16.892397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:16.892451 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:16.892541 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:16.893036 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.893637 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.894520 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:16.894830 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:16.895219 (+ 389us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:16.899088 (+ 3869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:34731: BlockingRecv error: recv got EOF from 127.11.118.130:34731 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:17.121327 22049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:17.114830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:57159)
0812 09:51:17.115153 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:17.115167 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:17.115260 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:17.115561 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:17.115564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:17.115767 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:17.115879 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.115885 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.116702 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.116704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.117478 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.117489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.117948 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.117950 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.118019 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.118672 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:17.118685 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:17.121134 (+ 2449us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":76,"threads_started":1}
W20260812 09:51:17.121397 22047 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:17.115018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:57159 (local address 127.11.118.190:45543)
0812 09:51:17.115192 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:17.115196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:17.115230 (+ 34us) server_negotiation.cc:407] Connection header received
0812 09:51:17.115364 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:17.115366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:17.115416 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:17.115493 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:17.116030 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.116587 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.117598 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.117825 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.117907 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.121277 (+ 3370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:57159: BlockingRecv error: recv got EOF from 127.11.118.131:57159 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:17.710582 22050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:17.704391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:59885)
0812 09:51:17.704715 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:17.704730 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:17.704893 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:17.705177 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:17.705180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:17.705394 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:17.705500 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.705506 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.706458 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.706461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.707198 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.707209 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.707693 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.707696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.707781 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.708321 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:17.708334 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:17.710439 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":135,"threads_started":1}
W20260812 09:51:17.710920 22051 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:17.704509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:59885 (local address 127.11.118.190:45543)
0812 09:51:17.704871 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:17.704875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:17.704890 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:51:17.704994 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:17.704997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:17.705041 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:17.705130 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:17.705649 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.706263 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.707320 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.707558 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.707647 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.710688 (+ 3041us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:59885: BlockingRecv error: recv got EOF from 127.11.118.129:59885 (error 108)
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":88,"threads_started":1}
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:17 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:17.906629 22052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:17.900361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:39597)
0812 09:51:17.900746 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:17.900767 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:17.900944 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:17.901239 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:17.901242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:17.901501 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:17.901597 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.901604 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.902382 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.902387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.903077 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:17.903088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.903562 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.903566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:17.903655 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.904260 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:17.904273 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:17.906422 (+ 2149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":94,"threads_started":1}
W20260812 09:51:17.906749 22051 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:17.900494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:39597 (local address 127.11.118.190:45543)
0812 09:51:17.900691 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:17.900696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:17.900883 (+ 187us) server_negotiation.cc:407] Connection header received
0812 09:51:17.901066 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:17.901069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:17.901122 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:17.901209 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:17.901720 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.902262 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.903203 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:17.903439 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:17.903555 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:17.906609 (+ 3054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:39597: BlockingRecv error: recv got EOF from 127.11.118.130:39597 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.131@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:18.128911 22053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:18.122349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.131:34931)
0812 09:51:18.122721 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:18.122738 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:18.122871 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:18.123184 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:18.123187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:18.123443 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:18.123540 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.123546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.124361 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.124366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.125025 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.125037 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.125621 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.125624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.125713 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.126375 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:18.126387 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:18.128719 (+ 2332us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":94,"threads_started":1}
W20260812 09:51:18.128993 22051 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:18.122530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:34931 (local address 127.11.118.190:45543)
0812 09:51:18.122722 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:18.122728 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:18.122813 (+ 85us) server_negotiation.cc:407] Connection header received
0812 09:51:18.123006 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:18.123009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:18.123068 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:18.123163 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:18.123673 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.124234 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.125187 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.125476 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.125582 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.128863 (+ 3281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.131:34931: BlockingRecv error: recv got EOF from 127.11.118.131:34931 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.129@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:18.719376 22055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:18.711594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.129:35847)
0812 09:51:18.711865 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:18.711879 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:18.711960 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:18.712252 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:18.712255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:18.712452 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:18.712552 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.712558 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.713486 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.713489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.714381 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.714394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.715654 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.715657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.715754 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.716477 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:18.716490 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:18.719233 (+ 2743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
W20260812 09:51:18.719663 22056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:18.711716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:35847 (local address 127.11.118.190:45543)
0812 09:51:18.711997 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:18.712001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:18.712013 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:51:18.712048 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:18.712050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:18.712095 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:18.712185 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:18.712703 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.713338 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.715211 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.715482 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.715587 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.719516 (+ 3929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.129:35847: BlockingRecv error: recv got EOF from 127.11.118.129:35847 (error 108)
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":85,"threads_started":1}
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
Aug 12 09:51:18 dist-test-slave-2w3w krb5kdc[20878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.118.130@KRBTEST.COM for oryx/127.11.118.190@KRBTEST.COM, Server not found in Kerberos database
I20260812 09:51:18.914350 22057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:18.907957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45543 (local address 127.11.118.130:41347)
0812 09:51:18.908264 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:18.908278 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:18.908376 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:18.908760 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:18.908764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:18.908981 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:18.909138 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.909155 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.910079 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.910082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.910672 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:18.910681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.911341 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.911344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:18.911420 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.912038 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:18.912051 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:18.914204 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.118.190:45543: Server oryx/127.11.118.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":107,"threads_started":1}
W20260812 09:51:18.914567 22056 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:18.908014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:41347 (local address 127.11.118.190:45543)
0812 09:51:18.908167 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:18.908171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:18.908383 (+ 212us) server_negotiation.cc:407] Connection header received
0812 09:51:18.908447 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:18.908449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:18.908498 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:18.908588 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:18.909306 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.909953 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.910807 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:18.911081 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:18.911339 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:18.914426 (+ 3087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.118.130:41347: BlockingRecv error: recv got EOF from 127.11.118.130:41347 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 09:51:19.003829 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21521
I20260812 09:51:19.016657 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21694
I20260812 09:51:19.025843 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21839
I20260812 09:51:19.037730 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 21442
2026-08-12T09:51:19Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18402 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T09:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:19Z Disabled control of system clock
I20260812 09:51:19.076071 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44551
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:37337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:44551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 09:51:19.212265 22063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:19.212615 22063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:19.212682 22063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:19.217681 22063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:19.217761 22063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:19.217777 22063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:19.217813 22063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:19.217855 22063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:19.223351 22063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:44551
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:19.224936 22063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:19.226989 22063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:19.237288 22071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.237273 22068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.237306 22069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:19.237706 22063 server_base.cc:1034] running on GCE node
I20260812 09:51:19.238437 22063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:19.239898 22063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:19.241145 22063 hybrid_clock.cc:648] HybridClock initialized: now 1786528279241112 us; error 49 us; skew 500 ppm
I20260812 09:51:19.243446 22063 webserver.cc:460] Webserver started at http://127.11.118.190:37869/ using document root <none> and password file <none>
I20260812 09:51:19.244099 22063 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:19.244204 22063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:19.244467 22063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:19.246766 22063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "3512efb25a7bd6d1747ada7843890808"
server_key_iv: "0361e354fbc85558d2be5347e2435467"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.247517 22063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "3512efb25a7bd6d1747ada7843890808"
server_key_iv: "0361e354fbc85558d2be5347e2435467"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.251703 22063 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:51:19.254560 22077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.256062 22063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:51:19.256271 22063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "3512efb25a7bd6d1747ada7843890808"
server_key_iv: "0361e354fbc85558d2be5347e2435467"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.256435 22063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:19.276384 22063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:19.277179 22063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:19.277419 22063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:19.285162 22063 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:44551
I20260812 09:51:19.285173 22137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:44551 every 8 connection(s)
I20260812 09:51:19.286338 22063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:51:19.289881 22138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:19.294049 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22063
I20260812 09:51:19.294189 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:51:19.294555 11738 external_mini_cluster.cc:1428] Setting key 1f38c5987051fcfb5e50f05269a32222
I20260812 09:51:19.296790 22138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0: Bootstrap starting.
I20260812 09:51:19.299242 22138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:19.300042 22138 log.cc:824] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:19.302048 22138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0: No bootstrap required, opened a new log
I20260812 09:51:19.304828 22141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.296230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46362 (local address 127.11.118.190:44551)
0812 09:51:19.297043 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:19.297061 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:19.297102 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:51:19.297820 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:19.297840 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:19.298273 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:19.298628 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:19.299174 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.300296 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.301215 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.301715 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.301904 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.302817 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:19.302822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:19.302837 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:19.303372 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:19.303440 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:19.303462 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:19.303577 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:19.303735 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 09:51:19.304013 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":177,"threads_started":1}
I20260812 09:51:19.306305 22138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } }
I20260812 09:51:19.306574 22138 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:19.306659 22138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0e6d4ab1ab47eb895df4e07f3d46b0, State: Initialized, Role: FOLLOWER
I20260812 09:51:19.307168 22138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } }
I20260812 09:51:19.307358 22138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:51:19.307433 22138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:51:19.307534 22138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:19.308616 22138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } }
I20260812 09:51:19.308982 22138 leader_election.cc:302] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b0e6d4ab1ab47eb895df4e07f3d46b0; no voters:
I20260812 09:51:19.309309 22138 leader_election.cc:288] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:51:19.309482 22144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:51:19.309767 22144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0e6d4ab1ab47eb895df4e07f3d46b0, State: Running, Role: LEADER
I20260812 09:51:19.310247 22144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } }
I20260812 09:51:19.310794 22138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:51:19.312135 22146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } } }
I20260812 09:51:19.312280 22146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:19.312690 22147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b0e6d4ab1ab47eb895df4e07f3d46b0. Latest consensus state: current_term: 1 leader_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b0e6d4ab1ab47eb895df4e07f3d46b0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44551 } } }
I20260812 09:51:19.312835 22147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:19.312803 22156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:51:19.316044 22156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:51:19.322043 22156 catalog_manager.cc:1347] Generated new cluster ID: f78ebbffb44f4c9881f56435da6a3220
I20260812 09:51:19.322142 22156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:51:19.336916 22156 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:51:19.338115 22156 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:51:19.343003 22156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b0e6d4ab1ab47eb895df4e07f3d46b0: Generated new TSK 0
I20260812 09:51:19.343796 22156 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:51:19.348932 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--builtin_ntp_servers=127.11.118.148:37337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 09:51:19.472663 22170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:19.473024 22170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:19.473101 22170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:19.477520 22170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:19.477624 22170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:19.477730 22170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:51:19.482923 22170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:19.484277 22170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:19.485865 22170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:51:19.496856 22170 server_base.cc:1034] running on GCE node
W20260812 09:51:19.496814 22175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.496971 22176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.496835 22178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:19.497764 22170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:19.498538 22170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:19.499733 22170 hybrid_clock.cc:648] HybridClock initialized: now 1786528279499694 us; error 53 us; skew 500 ppm
I20260812 09:51:19.501915 22170 webserver.cc:460] Webserver started at http://127.11.118.129:37689/ using document root <none> and password file <none>
I20260812 09:51:19.502568 22170 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:19.502640 22170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:19.502873 22170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:19.505282 22170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "913722d0909e4ebc8da6c772fa9a3811"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "235c2490ac2a3e030ad22966553fb837"
server_key_iv: "e77d363cc9c219fd9bba1579f2454743"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.505960 22170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "913722d0909e4ebc8da6c772fa9a3811"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "235c2490ac2a3e030ad22966553fb837"
server_key_iv: "e77d363cc9c219fd9bba1579f2454743"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.510306 22170 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:51:19.513504 22184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.515139 22170 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:19.515292 22170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "913722d0909e4ebc8da6c772fa9a3811"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "235c2490ac2a3e030ad22966553fb837"
server_key_iv: "e77d363cc9c219fd9bba1579f2454743"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.515442 22170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:19.531716 22170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:19.532543 22170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:19.532776 22170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:19.533448 22170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:19.534462 22170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:19.534536 22170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.534611 22170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:19.534653 22170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.544482 22170 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:33703
I20260812 09:51:19.544509 22317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:33703 every 8 connection(s)
I20260812 09:51:19.545460 22170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:51:19.547478 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22170
I20260812 09:51:19.547616 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:51:19.547953 11738 external_mini_cluster.cc:1428] Setting key 09760eba8600142920f8034c7f15921d
I20260812 09:51:19.550319 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--builtin_ntp_servers=127.11.118.148:37337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 09:51:19.556908 22141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.547562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:44107 (local address 127.11.118.190:44551)
0812 09:51:19.547739 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:19.547743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:19.549215 (+ 1472us) server_negotiation.cc:407] Connection header received
0812 09:51:19.550879 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:19.550883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:19.551038 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:19.551145 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:19.552150 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.552721 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.554576 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.554857 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.555020 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.556398 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:19.556401 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:19.556403 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:19.556416 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:19.556436 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:19.556444 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:19.556514 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:19.556722 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 09:51:19.556784 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 09:51:19.558351 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.548165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44551 (local address 127.11.118.129:44107)
0812 09:51:19.549033 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:19.549090 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:19.550662 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:19.551333 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:19.551339 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:19.551431 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:19.551956 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.551980 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.552865 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.552870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.554417 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.554432 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.555079 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.555085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.555330 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.556043 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:19.556046 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:19.556111 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:19.556212 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:19.556544 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:19.556557 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:19.556566 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 09:51:19.556722 (+ 156us) client_negotiation.cc:240] Negotiation successful
0812 09:51:19.557085 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":168,"threads_started":1}
I20260812 09:51:19.560084 22318 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44551
I20260812 09:51:19.560400 22318 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:19.561208 22318 heartbeater.cc:511] Master 127.11.118.190:44551 requested a full tablet report, sending...
I20260812 09:51:19.563151 22098 ts_manager.cc:194] Registered new tserver with Master: 913722d0909e4ebc8da6c772fa9a3811 (127.11.118.129:33703)
I20260812 09:51:19.564435 22098 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.129:44107
W20260812 09:51:19.672020 22321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:19.672381 22321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:19.672466 22321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:19.676790 22321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:19.676925 22321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:19.677024 22321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:51:19.682090 22321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:19.683408 22321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:19.684926 22321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:19.695734 22329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.695737 22327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.695807 22326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:19.695966 22321 server_base.cc:1034] running on GCE node
I20260812 09:51:19.696508 22321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:19.697247 22321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:19.698453 22321 hybrid_clock.cc:648] HybridClock initialized: now 1786528279698436 us; error 29 us; skew 500 ppm
I20260812 09:51:19.703855 22321 webserver.cc:460] Webserver started at http://127.11.118.130:43739/ using document root <none> and password file <none>
I20260812 09:51:19.704540 22321 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:19.704645 22321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:19.704873 22321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:19.707161 22321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "2ef00e0c5d0d43b09224bdae5505aa3c"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "333a76e009ce007813bdcde103aad6d2"
server_key_iv: "7659c628b6ee91f1a1a0aeb4d7f2b6fe"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.707772 22321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "2ef00e0c5d0d43b09224bdae5505aa3c"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "333a76e009ce007813bdcde103aad6d2"
server_key_iv: "7659c628b6ee91f1a1a0aeb4d7f2b6fe"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.711846 22321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:51:19.715062 22335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.716533 22321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:19.716728 22321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "2ef00e0c5d0d43b09224bdae5505aa3c"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "333a76e009ce007813bdcde103aad6d2"
server_key_iv: "7659c628b6ee91f1a1a0aeb4d7f2b6fe"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.716887 22321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:19.759625 22321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:19.760488 22321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:19.760730 22321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:19.761456 22321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:19.762558 22321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:19.762640 22321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.762720 22321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:19.762779 22321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.773417 22321 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:37155
I20260812 09:51:19.773437 22465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:37155 every 8 connection(s)
I20260812 09:51:19.774451 22321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:51:19.779767 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22321
I20260812 09:51:19.779908 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:51:19.780218 11738 external_mini_cluster.cc:1428] Setting key 19105cca23e42a523997e7cb2980fcf8
I20260812 09:51:19.782313 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--builtin_ntp_servers=127.11.118.148:37337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 09:51:19.785356 22141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.776683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58745 (local address 127.11.118.190:44551)
0812 09:51:19.776868 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:19.776873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:19.778025 (+ 1152us) server_negotiation.cc:407] Connection header received
0812 09:51:19.779589 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:19.779593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:19.779668 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:19.779829 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:19.781064 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.781675 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.783048 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.783443 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.783572 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.784765 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:19.784769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:19.784774 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:19.784791 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:19.784817 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:19.784829 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:19.784919 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:19.785073 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 09:51:19.785147 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 09:51:19.786437 22468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.777120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44551 (local address 127.11.118.130:58745)
0812 09:51:19.777849 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:19.777897 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:19.779292 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:19.780108 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:19.780115 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:19.780204 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:19.780912 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.780929 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.781859 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.781862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.782883 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.782893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.783629 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.783632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.783786 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.784478 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:19.784479 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:19.784523 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:19.784594 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:19.784925 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:19.784934 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:19.784938 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 09:51:19.785041 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 09:51:19.785288 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":134,"threads_started":1}
I20260812 09:51:19.787750 22466 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44551
I20260812 09:51:19.788014 22466 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:19.788583 22466 heartbeater.cc:511] Master 127.11.118.190:44551 requested a full tablet report, sending...
I20260812 09:51:19.789690 22098 ts_manager.cc:194] Registered new tserver with Master: 2ef00e0c5d0d43b09224bdae5505aa3c (127.11.118.130:37155)
I20260812 09:51:19.790287 22098 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.130:58745
W20260812 09:51:19.904386 22469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:19.904740 22469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:19.904817 22469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:19.909108 22469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:19.909233 22469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:19.909332 22469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:51:19.914836 22469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:37337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:19.916090 22469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:19.917575 22469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:19.928586 22477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:19.928577 22478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:19.928722 22469 server_base.cc:1034] running on GCE node
W20260812 09:51:19.928577 22480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:19.929463 22469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:19.930316 22469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:19.931546 22469 hybrid_clock.cc:648] HybridClock initialized: now 1786528279931530 us; error 29 us; skew 500 ppm
I20260812 09:51:19.933845 22469 webserver.cc:460] Webserver started at http://127.11.118.131:39609/ using document root <none> and password file <none>
I20260812 09:51:19.934522 22469 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:19.934635 22469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:19.935025 22469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:19.937323 22469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "e39234d3816a4082aac5a3e93952b400"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "1e93c0a1d9ad8754807c5850b930c4de"
server_key_iv: "21d233e822bbaf56aaf7b058f947cff4"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.937969 22469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "e39234d3816a4082aac5a3e93952b400"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "1e93c0a1d9ad8754807c5850b930c4de"
server_key_iv: "21d233e822bbaf56aaf7b058f947cff4"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.942446 22469 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:51:19.945776 22487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.947422 22469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:19.947597 22469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "e39234d3816a4082aac5a3e93952b400"
format_stamp: "Formatted at 2026-08-12 09:51:19 on dist-test-slave-2w3w"
server_key: "1e93c0a1d9ad8754807c5850b930c4de"
server_key_iv: "21d233e822bbaf56aaf7b058f947cff4"
server_key_version: "encryptionkey@0"
I20260812 09:51:19.947746 22469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:19.962013 22469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:19.962822 22469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:19.963099 22469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:19.963814 22469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:19.964921 22469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:19.964999 22469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.965076 22469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:19.965121 22469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:19.976009 22469 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:40589
I20260812 09:51:19.976032 22621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:40589 every 8 connection(s)
I20260812 09:51:19.977082 22469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:51:19.981529 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22469
I20260812 09:51:19.981678 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:51:19.982077 11738 external_mini_cluster.cc:1428] Setting key 34b9ea8bf387ad7eaa56727a931aeef4
I20260812 09:51:19.988492 22141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.979228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:50767 (local address 127.11.118.190:44551)
0812 09:51:19.979404 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:19.979410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:19.980683 (+ 1273us) server_negotiation.cc:407] Connection header received
0812 09:51:19.982648 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:19.982652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:19.982719 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:19.982833 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:19.983999 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.984544 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.985865 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.986130 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.986234 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.987878 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:19.987881 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:19.987892 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:19.987909 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:19.987931 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:19.987941 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:19.988008 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:19.988273 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 09:51:19.988350 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:51:19.989493 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:19.979716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44551 (local address 127.11.118.131:50767)
0812 09:51:19.980503 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:19.980548 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:19.982320 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:19.983095 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:19.983103 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:19.983203 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:19.983846 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.983862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.984686 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.984689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.985653 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:19.985665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:19.986469 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:19.986473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:19.986675 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:19.987500 (+ 825us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:19.987502 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:19.987553 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:19.987633 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:19.988050 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:19.988066 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:19.988071 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 09:51:19.988205 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 09:51:19.988489 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":148,"threads_started":1}
I20260812 09:51:19.991052 22622 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44551
I20260812 09:51:19.991307 22622 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:19.991894 22622 heartbeater.cc:511] Master 127.11.118.190:44551 requested a full tablet report, sending...
I20260812 09:51:19.993098 22098 ts_manager.cc:194] Registered new tserver with Master: e39234d3816a4082aac5a3e93952b400 (127.11.118.131:40589)
I20260812 09:51:19.993736 22098 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.131:50767
I20260812 09:51:19.996706 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 09:51:19.999893 22141 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:19.998883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.11.118.190:44551)
0812 09:51:19.999056 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:19.999060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:19.999219 (+ 159us) server_negotiation.cc:407] Connection header received
0812 09:51:19.999290 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:19.999297 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:19.999361 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:19.999441 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:19.999741 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46364: BlockingRecv error: recv got EOF from 127.0.0.1:46364 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:51:20.000295 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22170
I20260812 09:51:20.013399 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22321
I20260812 09:51:20.020923 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22469
I20260812 09:51:20.028890 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22063
2026-08-12T09:51:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (988 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T09:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:20Z Disabled control of system clock
I20260812 09:51:20.063755 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44873
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:44873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 09:51:20.183887 22635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:20.184372 22635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:20.184422 22635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:20.188875 22635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:20.188977 22635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:20.188993 22635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:20.189013 22635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:20.189030 22635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:20.194741 22635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:44873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:20.196059 22635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:20.197496 22635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:20.207057 22644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.207131 22635 server_base.cc:1034] running on GCE node
W20260812 09:51:20.206899 22643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:20.206919 22647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.208010 22635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:20.209237 22635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:20.210448 22635 hybrid_clock.cc:648] HybridClock initialized: now 1786528280210417 us; error 47 us; skew 500 ppm
I20260812 09:51:20.212643 22635 webserver.cc:460] Webserver started at http://127.11.118.190:33339/ using document root <none> and password file <none>
I20260812 09:51:20.213294 22635 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:20.213397 22635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:20.213644 22635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:20.215996 22635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "0efa54d27ea440a18ca58de29baa6de2"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "6e17ed90da6334a43fadfc61beca89d2"
server_key_iv: "bac390b31553466878ce2841ad6d74a0"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.216645 22635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "0efa54d27ea440a18ca58de29baa6de2"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "6e17ed90da6334a43fadfc61beca89d2"
server_key_iv: "bac390b31553466878ce2841ad6d74a0"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.221320 22635 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:51:20.224354 22653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.226162 22635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:51:20.226365 22635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "0efa54d27ea440a18ca58de29baa6de2"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "6e17ed90da6334a43fadfc61beca89d2"
server_key_iv: "bac390b31553466878ce2841ad6d74a0"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.226529 22635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:20.232048 22635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:20.232805 22635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:20.233028 22635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:20.240845 22635 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:44873
I20260812 09:51:20.241004 22714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:44873 every 8 connection(s)
I20260812 09:51:20.241962 22635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:51:20.245852 22715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:20.251447 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22635
I20260812 09:51:20.251607 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:51:20.251930 11738 external_mini_cluster.cc:1428] Setting key 443dc7baf0491e8e1587d64b94e0a3f8
I20260812 09:51:20.252586 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2: Bootstrap starting.
I20260812 09:51:20.255592 22715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:20.256425 22715 log.cc:824] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:20.258778 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.253748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42266 (local address 127.11.118.190:44873)
0812 09:51:20.254702 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:20.254731 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:20.254776 (+ 45us) server_negotiation.cc:407] Connection header received
0812 09:51:20.255592 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:20.255612 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:20.256037 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:20.256407 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:20.257453 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:20.257457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:20.257470 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:20.257477 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:20.257525 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:20.257541 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:20.257669 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:20.257785 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 09:51:20.258043 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":202,"threads_started":1}
I20260812 09:51:20.259351 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2: No bootstrap required, opened a new log
I20260812 09:51:20.264397 22715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } }
I20260812 09:51:20.264729 22715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:20.264839 22715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efa54d27ea440a18ca58de29baa6de2, State: Initialized, Role: FOLLOWER
I20260812 09:51:20.265384 22715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } }
I20260812 09:51:20.265528 22715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:51:20.265574 22715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:51:20.265645 22715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:20.266705 22715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } }
I20260812 09:51:20.267113 22715 leader_election.cc:302] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0efa54d27ea440a18ca58de29baa6de2; no voters:
I20260812 09:51:20.267469 22715 leader_election.cc:288] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:51:20.267560 22720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:51:20.267784 22720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [term 1 LEADER]: Becoming Leader. State: Replica: 0efa54d27ea440a18ca58de29baa6de2, State: Running, Role: LEADER
I20260812 09:51:20.268105 22720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } }
I20260812 09:51:20.268988 22715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:51:20.270212 22721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0efa54d27ea440a18ca58de29baa6de2. Latest consensus state: current_term: 1 leader_uuid: "0efa54d27ea440a18ca58de29baa6de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } } }
I20260812 09:51:20.270272 22722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0efa54d27ea440a18ca58de29baa6de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efa54d27ea440a18ca58de29baa6de2" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44873 } } }
I20260812 09:51:20.270834 22721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:20.270843 22722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:20.271474 22729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:51:20.274490 22729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:51:20.280642 22729 catalog_manager.cc:1347] Generated new cluster ID: 94b4c389633e4002866ccd2d26fbe2e5
I20260812 09:51:20.280742 22729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:51:20.295365 22729 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:51:20.295779 22729 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:51:20.307019 22729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0efa54d27ea440a18ca58de29baa6de2: Generated new TSK 0
I20260812 09:51:20.308079 22729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:51:20.314576 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--builtin_ntp_servers=127.11.118.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 09:51:20.432411 22739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:20.432747 22739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:20.432823 22739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:20.437114 22739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:20.437228 22739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:20.437330 22739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:51:20.442390 22739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:20.443650 22739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:20.445115 22739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:20.456259 22749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:20.456248 22746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:20.456274 22745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.456682 22739 server_base.cc:1034] running on GCE node
I20260812 09:51:20.457155 22739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:20.457929 22739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:20.459120 22739 hybrid_clock.cc:648] HybridClock initialized: now 1786528280459092 us; error 42 us; skew 500 ppm
I20260812 09:51:20.461278 22739 webserver.cc:460] Webserver started at http://127.11.118.129:35469/ using document root <none> and password file <none>
I20260812 09:51:20.461959 22739 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:20.462064 22739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:20.462323 22739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:20.464654 22739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "0b845cf290d24b64be24f33b74e25aa8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "f004180733acf78b2613316d6b9c9e0c"
server_key_iv: "87b2fcf5684d183fd99f0a42933fe493"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.465302 22739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "0b845cf290d24b64be24f33b74e25aa8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "f004180733acf78b2613316d6b9c9e0c"
server_key_iv: "87b2fcf5684d183fd99f0a42933fe493"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.470077 22739 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:51:20.473513 22757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.475325 22739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 09:51:20.475507 22739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "0b845cf290d24b64be24f33b74e25aa8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "f004180733acf78b2613316d6b9c9e0c"
server_key_iv: "87b2fcf5684d183fd99f0a42933fe493"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.475663 22739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:20.481606 22739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:20.482298 22739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:20.482512 22739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:20.483203 22739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:20.484277 22739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:20.484351 22739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.484462 22739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:20.484530 22739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.496025 22739 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:36735
I20260812 09:51:20.496102 22889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:36735 every 8 connection(s)
I20260812 09:51:20.497404 22739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:51:20.502588 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22739
I20260812 09:51:20.502800 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:51:20.503214 11738 external_mini_cluster.cc:1428] Setting key da2e322d1986dda10c391b4741b6b426
I20260812 09:51:20.505064 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.499946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:60077 (local address 127.11.118.190:44873)
0812 09:51:20.500127 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:20.500131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:20.501295 (+ 1164us) server_negotiation.cc:407] Connection header received
0812 09:51:20.502744 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:20.502748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:20.502794 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:20.502899 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:20.504368 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:20.504373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:20.504375 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:20.504397 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:20.504434 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:20.504445 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:20.504727 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:20.504793 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 09:51:20.504848 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 09:51:20.505671 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--builtin_ntp_servers=127.11.118.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 09:51:20.506138 22892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.500371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44873 (local address 127.11.118.129:60077)
0812 09:51:20.501121 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:20.501169 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:20.502513 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:20.503126 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:20.503134 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:20.503228 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:20.503911 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:20.503913 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:20.503982 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:20.504080 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:20.504630 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:20.504639 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:20.504644 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 09:51:20.504822 (+ 178us) client_negotiation.cc:240] Negotiation successful
0812 09:51:20.505112 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":143,"threads_started":1}
I20260812 09:51:20.507686 22890 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44873
I20260812 09:51:20.507978 22890 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:20.508476 22890 heartbeater.cc:511] Master 127.11.118.190:44873 requested a full tablet report, sending...
I20260812 09:51:20.510313 22673 ts_manager.cc:194] Registered new tserver with Master: 0b845cf290d24b64be24f33b74e25aa8 (127.11.118.129:36735)
W20260812 09:51:20.627079 22893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:20.627380 22893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:20.627483 22893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:20.631896 22893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:20.631973 22893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:20.632069 22893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:51:20.637210 22893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:20.638450 22893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:20.639966 22893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:20.650261 22900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.650350 22893 server_base.cc:1034] running on GCE node
W20260812 09:51:20.650254 22902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:20.650278 22905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.651074 22893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:20.651780 22893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:20.652990 22893 hybrid_clock.cc:648] HybridClock initialized: now 1786528280652977 us; error 35 us; skew 500 ppm
I20260812 09:51:20.655118 22893 webserver.cc:460] Webserver started at http://127.11.118.130:40197/ using document root <none> and password file <none>
I20260812 09:51:20.655699 22893 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:20.655763 22893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:20.655943 22893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:20.658126 22893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "717b6731e52e474daf106a451cab4612"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "feb24ff767b83eb168fa69a60fa294e7"
server_key_iv: "f31ed245feb33f48a545c3f682be752e"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.658694 22893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "717b6731e52e474daf106a451cab4612"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "feb24ff767b83eb168fa69a60fa294e7"
server_key_iv: "f31ed245feb33f48a545c3f682be752e"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.662636 22893 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260812 09:51:20.665699 22913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.667204 22893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:20.667318 22893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "717b6731e52e474daf106a451cab4612"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "feb24ff767b83eb168fa69a60fa294e7"
server_key_iv: "f31ed245feb33f48a545c3f682be752e"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.667490 22893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:20.672600 22893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:20.673262 22893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:20.673466 22893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:20.674082 22893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:20.675138 22893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:20.675189 22893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.675253 22893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:20.675288 22893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.684530 22893 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:46815
I20260812 09:51:20.684558 23042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:46815 every 8 connection(s)
I20260812 09:51:20.685487 22893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:51:20.692008 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.687588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:36077 (local address 127.11.118.190:44873)
0812 09:51:20.687740 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:20.687744 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:20.688869 (+ 1125us) server_negotiation.cc:407] Connection header received
0812 09:51:20.690192 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:20.690195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:20.690243 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:20.690325 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:20.691595 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:20.691598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:20.691601 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:20.691612 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:20.691634 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:20.691642 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:20.691735 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:20.691847 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 09:51:20.691893 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:51:20.692878 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.688012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44873 (local address 127.11.118.130:36077)
0812 09:51:20.688719 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:20.688760 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:20.689971 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:20.690506 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:20.690512 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:20.690597 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:20.691307 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:20.691309 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:20.691350 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:20.691425 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:20.691716 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:20.691720 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:20.691724 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 09:51:20.691845 (+ 121us) client_negotiation.cc:240] Negotiation successful
0812 09:51:20.692035 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":132,"threads_started":1}
I20260812 09:51:20.694068 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 22893
I20260812 09:51:20.694083 23043 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44873
I20260812 09:51:20.694212 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:51:20.694341 23043 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:20.694561 11738 external_mini_cluster.cc:1428] Setting key d49865dd4d92149b42d0438c2588becd
I20260812 09:51:20.694856 23043 heartbeater.cc:511] Master 127.11.118.190:44873 requested a full tablet report, sending...
I20260812 09:51:20.695988 22671 ts_manager.cc:194] Registered new tserver with Master: 717b6731e52e474daf106a451cab4612 (127.11.118.130:46815)
I20260812 09:51:20.696605 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--builtin_ntp_servers=127.11.118.148:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 09:51:20.817020 23047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:20.817341 23047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:20.817385 23047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:20.821748 23047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:20.821836 23047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:20.821898 23047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:51:20.827193 23047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:44873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:20.828428 23047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:20.829905 23047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:20.840374 23055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:20.840387 23054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.840525 23047 server_base.cc:1034] running on GCE node
W20260812 09:51:20.840387 23058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:20.841135 23047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:20.841876 23047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:20.843081 23047 hybrid_clock.cc:648] HybridClock initialized: now 1786528280843046 us; error 47 us; skew 500 ppm
I20260812 09:51:20.845324 23047 webserver.cc:460] Webserver started at http://127.11.118.131:41671/ using document root <none> and password file <none>
I20260812 09:51:20.846167 23047 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:20.846284 23047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:20.846580 23047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:20.849615 23047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "b2494551e5984312a0cf16b3b85c05a8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "22206abcdd43de512afd725700d591af"
server_key_iv: "6a9344ee71f49fa8f841f4e0efc03986"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.850200 23047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "b2494551e5984312a0cf16b3b85c05a8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "22206abcdd43de512afd725700d591af"
server_key_iv: "6a9344ee71f49fa8f841f4e0efc03986"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.854431 23047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:51:20.857398 23065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.858726 23047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:20.858868 23047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "b2494551e5984312a0cf16b3b85c05a8"
format_stamp: "Formatted at 2026-08-12 09:51:20 on dist-test-slave-2w3w"
server_key: "22206abcdd43de512afd725700d591af"
server_key_iv: "6a9344ee71f49fa8f841f4e0efc03986"
server_key_version: "encryptionkey@0"
I20260812 09:51:20.859079 23047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:20.864050 23047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:20.864764 23047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:20.864975 23047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:20.865576 23047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:20.866559 23047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:20.866613 23047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.866686 23047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:20.866729 23047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:20.876842 23047 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:44949
I20260812 09:51:20.876863 23194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:44949 every 8 connection(s)
I20260812 09:51:20.877846 23047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:51:20.884480 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 23047
I20260812 09:51:20.884630 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:51:20.884759 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.879898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:36921 (local address 127.11.118.190:44873)
0812 09:51:20.880081 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:20.880086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:20.881330 (+ 1244us) server_negotiation.cc:407] Connection header received
0812 09:51:20.882672 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:20.882675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:20.882716 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:20.882851 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:20.884182 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:20.884185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:20.884187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:51:20.884201 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:20.884224 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:51:20.884232 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:20.884331 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:20.884512 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 09:51:20.884556 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:51:20.884965 11738 external_mini_cluster.cc:1428] Setting key 080a4096f769f47b00d7587d2affbb85
I20260812 09:51:20.886010 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:20.880387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:44873 (local address 127.11.118.131:36921)
0812 09:51:20.881162 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:20.881206 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:20.882435 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:20.883096 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:20.883105 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:20.883202 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:20.883856 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:51:20.883858 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:20.883909 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:51:20.883986 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:20.884334 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:20.884345 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:20.884352 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:51:20.884560 (+ 208us) client_negotiation.cc:240] Negotiation successful
0812 09:51:20.884860 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":122,"threads_started":1}
I20260812 09:51:20.887240 23195 heartbeater.cc:347] Connected to a master server at 127.11.118.190:44873
I20260812 09:51:20.887501 23195 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:20.887954 23195 heartbeater.cc:511] Master 127.11.118.190:44873 requested a full tablet report, sending...
I20260812 09:51:20.889047 22671 ts_manager.cc:194] Registered new tserver with Master: b2494551e5984312a0cf16b3b85c05a8 (127.11.118.131:44949)
I20260812 09:51:20.899734 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 09:51:20.902877 22718 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:51:20.901867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.11.118.190:44873)
0812 09:51:20.902048 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:20.902053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:20.902183 (+ 130us) server_negotiation.cc:407] Connection header received
0812 09:51:20.902344 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:20.902350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:20.902396 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:20.902483 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:20.902718 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42276: BlockingRecv error: recv got EOF from 127.0.0.1:42276 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 09:51:20.903218 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22739
I20260812 09:51:20.911572 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22893
I20260812 09:51:20.921663 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 23047
I20260812 09:51:20.930009 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 22635
2026-08-12T09:51:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (900 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:51:21 dist-test-slave-2w3w krb5kdc[23206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:51:21 dist-test-slave-2w3w krb5kdc[23206](info): set up 2 sockets
Aug 12 09:51:21 dist-test-slave-2w3w krb5kdc[23206](info): commencing operation
krb5kdc: starting...
W20260812 09:51:22.105538 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:51:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:51:22.255976 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38377
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:22.372124 23224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:22.372435 23224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:22.372478 23224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:22.376789 23224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:51:22.376868 23224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:22.376894 23224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:22.376912 23224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:51:22.376928 23224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:51:22.382591 23224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:22.383821 23224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:22.384819 23224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:22.393846 23231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.393858 23234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.393858 23232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:22.393970 23224 server_base.cc:1034] running on GCE node
I20260812 09:51:22.394819 23224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:22.396067 23224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:22.397258 23224 hybrid_clock.cc:648] HybridClock initialized: now 1786528282397237 us; error 39 us; skew 500 ppm
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:22.400535 23224 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:51:22.401567 23224 webserver.cc:460] Webserver started at http://127.11.118.190:42187/ using document root <none> and password file <none>
I20260812 09:51:22.402190 23224 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:22.402293 23224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:22.402549 23224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:22.404927 23224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "669d771daf0144488b73e10852bc90e4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "b89714183f1f1c4365c2eaf97b6bbbc8"
server_key_iv: "cd26faf12ffa6108d4e878752ff27983"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.405596 23224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "669d771daf0144488b73e10852bc90e4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "b89714183f1f1c4365c2eaf97b6bbbc8"
server_key_iv: "cd26faf12ffa6108d4e878752ff27983"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.409950 23224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 09:51:22.412935 23242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.414283 23224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:51:22.414409 23224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "669d771daf0144488b73e10852bc90e4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "b89714183f1f1c4365c2eaf97b6bbbc8"
server_key_iv: "cd26faf12ffa6108d4e878752ff27983"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.414565 23224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:22.432281 23224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:22.436210 23224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:22.436419 23224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:22.444128 23224 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:38377
I20260812 09:51:22.444439 23300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:38377 every 8 connection(s)
I20260812 09:51:22.445276 23224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:51:22.448455 23301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:22.454452 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 23224
I20260812 09:51:22.454561 23301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: Bootstrap starting.
I20260812 09:51:22.454600 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:51:22.454916 11738 external_mini_cluster.cc:1428] Setting key 92bd3e32153536694fe8c0d3514191e2
I20260812 09:51:22.457472 23301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:22.458256 23301 log.cc:824] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:22.460381 23301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: No bootstrap required, opened a new log
I20260812 09:51:22.464406 23301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } }
I20260812 09:51:22.464658 23301 raft_consensus.cc:374] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:22.464692 23301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669d771daf0144488b73e10852bc90e4, State: Initialized, Role: FOLLOWER
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:22.465248 23301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } }
I20260812 09:51:22.465395 23301 raft_consensus.cc:388] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:51:22.465485 23301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:51:22.465595 23301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:22.467173 23301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } }
I20260812 09:51:22.467643 23301 leader_election.cc:302] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 669d771daf0144488b73e10852bc90e4; no voters:
I20260812 09:51:22.468083 23301 leader_election.cc:288] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:51:22.468263 23306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:51:22.468562 23306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [term 1 LEADER]: Becoming Leader. State: Replica: 669d771daf0144488b73e10852bc90e4, State: Running, Role: LEADER
I20260812 09:51:22.468940 23306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } }
I20260812 09:51:22.469660 23301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:51:22.471005 23307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 669d771daf0144488b73e10852bc90e4. Latest consensus state: current_term: 1 leader_uuid: "669d771daf0144488b73e10852bc90e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } } }
I20260812 09:51:22.471033 23308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "669d771daf0144488b73e10852bc90e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "669d771daf0144488b73e10852bc90e4" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38377 } } }
I20260812 09:51:22.471174 23308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:22.471174 23307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4 [sys.catalog]: This master's current role is: LEADER
I20260812 09:51:22.472503 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:22.456512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.11.118.190:38377)
0812 09:51:22.457004 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:22.457022 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:22.457060 (+ 38us) server_negotiation.cc:407] Connection header received
0812 09:51:22.457887 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:22.457909 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:22.458261 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:22.458673 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:22.459590 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.460690 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.461631 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.462194 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.462391 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:22.465688 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:22.465697 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:22.465716 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:22.465756 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:22.468266 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:22.468913 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:22.468919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:22.468925 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:22.469106 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:22.469461 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:22.469465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:22.469466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:22.470021 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:22.470248 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:22.471020 (+ 772us) server_negotiation.cc:299] Negotiation successful
0812 09:51:22.471370 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":148,"threads_started":1}
I20260812 09:51:22.471823 23315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:51:22.476199 23315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:51:22.482965 23315 catalog_manager.cc:1347] Generated new cluster ID: f882b7ac00144c1ca350ae66df74eb87
I20260812 09:51:22.483086 23315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:51:22.490785 23315 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:51:22.491861 23315 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:51:22.498219 23315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: Generated new TSK 0
I20260812 09:51:22.499150 23315 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:51:22.538676 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:22.664395 23329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:22.664705 23329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:22.664752 23329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:22.668987 23329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:22.669068 23329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:22.669138 23329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:51:22.675081 23329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:22.676373 23329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:22.677413 23329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:22.688726 23335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.688571 23338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.688570 23334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:22.688892 23329 server_base.cc:1034] running on GCE node
I20260812 09:51:22.689486 23329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:22.690176 23329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:22.691370 23329 hybrid_clock.cc:648] HybridClock initialized: now 1786528282691342 us; error 46 us; skew 500 ppm
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:22.694490 23329 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:51:22.695688 23329 webserver.cc:460] Webserver started at http://127.11.118.129:45991/ using document root <none> and password file <none>
I20260812 09:51:22.696381 23329 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:22.696456 23329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:22.696699 23329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:22.699023 23329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "618222dc1f4548b1a8da3a61aff34164"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "aea9c8cbbd57234a1c3576edb24261bb"
server_key_iv: "5b4dd1c40101885937cdbfcf405805d0"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.699712 23329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "618222dc1f4548b1a8da3a61aff34164"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "aea9c8cbbd57234a1c3576edb24261bb"
server_key_iv: "5b4dd1c40101885937cdbfcf405805d0"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.704048 23329 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:51:22.706751 23347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.708185 23329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:51:22.708349 23329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "618222dc1f4548b1a8da3a61aff34164"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "aea9c8cbbd57234a1c3576edb24261bb"
server_key_iv: "5b4dd1c40101885937cdbfcf405805d0"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.708498 23329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:22.734329 23329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:22.738356 23329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:22.738606 23329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:22.739364 23329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:22.740284 23329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:22.740337 23329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.740383 23329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:22.740439 23329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.752964 23329 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:45931
I20260812 09:51:22.752982 23471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:45931 every 8 connection(s)
I20260812 09:51:22.754328 23329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:51:22.757643 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 23329
I20260812 09:51:22.757789 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:51:22.758133 11738 external_mini_cluster.cc:1428] Setting key 8483e2e1977d0960361f5cc798684b91
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:51:22.771262 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:22.756402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:33809 (local address 127.11.118.190:38377)
0812 09:51:22.756577 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:22.756581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:22.757559 (+ 978us) server_negotiation.cc:407] Connection header received
0812 09:51:22.759450 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:22.759453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:22.759503 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:22.759580 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:22.761317 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.761934 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.763409 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.763698 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.763802 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:22.766837 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:22.766841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:22.766843 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:22.766872 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:22.768498 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:22.769131 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:22.769135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:22.769137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:22.769293 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:22.769713 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:22.769718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:22.769719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:22.769936 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:22.770052 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:22.770724 (+ 672us) server_negotiation.cc:299] Negotiation successful
0812 09:51:22.771080 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 09:51:22.772245 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:22.756812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38377 (local address 127.11.118.129:33809)
0812 09:51:22.757347 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:22.757418 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:22.759176 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:22.759790 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:22.759798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:22.760341 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:22.761115 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:22.761140 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.762144 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.762150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:22.763270 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:22.763281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:22.763963 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:22.763967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:22.764153 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:22.764944 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:22.764963 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:22.766605 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:22.768649 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:22.768656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:22.768675 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:22.769006 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:22.769418 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:22.769421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:22.769423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:22.769606 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:22.770051 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:22.770061 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:22.770466 (+ 405us) client_negotiation.cc:769] Sending connection context
0812 09:51:22.770685 (+ 219us) client_negotiation.cc:240] Negotiation successful
0812 09:51:22.771275 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":127,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:51:22.773675 23473 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38377
I20260812 09:51:22.773977 23473 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:22.774561 23473 heartbeater.cc:511] Master 127.11.118.190:38377 requested a full tablet report, sending...
I20260812 09:51:22.776871 23257 ts_manager.cc:194] Registered new tserver with Master: 618222dc1f4548b1a8da3a61aff34164 (127.11.118.129:45931)
I20260812 09:51:22.778367 23257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:33809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:51:22.795593 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:22.919925 23478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:22.920233 23478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:22.920280 23478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:22.924543 23478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:22.924630 23478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:22.924697 23478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:51:22.930544 23478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:22.931814 23478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:22.932864 23478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:22.943970 23485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.943994 23486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:22.943970 23489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:22.944363 23478 server_base.cc:1034] running on GCE node
I20260812 09:51:22.944856 23478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:22.945613 23478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:22.947007 23478 hybrid_clock.cc:648] HybridClock initialized: now 1786528282946921 us; error 45 us; skew 500 ppm
Aug 12 09:51:22 dist-test-slave-2w3w krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:22.950488 23478 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:51:22.951566 23478 webserver.cc:460] Webserver started at http://127.11.118.130:34409/ using document root <none> and password file <none>
I20260812 09:51:22.952140 23478 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:22.952208 23478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:22.952399 23478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:22.954596 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "d579089c5b7044fc89cb3f95a372fbf4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "fd7d0e8754143a9676c768a5eb61aa91"
server_key_iv: "55ad4fdc43224057b79d40075dc505df"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.955271 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "d579089c5b7044fc89cb3f95a372fbf4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "fd7d0e8754143a9676c768a5eb61aa91"
server_key_iv: "55ad4fdc43224057b79d40075dc505df"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.959578 23478 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:51:22.962374 23498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.964239 23478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:51:22.964452 23478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "d579089c5b7044fc89cb3f95a372fbf4"
format_stamp: "Formatted at 2026-08-12 09:51:22 on dist-test-slave-2w3w"
server_key: "fd7d0e8754143a9676c768a5eb61aa91"
server_key_iv: "55ad4fdc43224057b79d40075dc505df"
server_key_version: "encryptionkey@0"
I20260812 09:51:22.964608 23478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:22.988891 23478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:22.993093 23478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:22.993346 23478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:22.994220 23478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:22.995385 23478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:22.995442 23478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:22.995494 23478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:22.995551 23478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:23.006676 23478 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:36003
I20260812 09:51:23.006696 23629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:36003 every 8 connection(s)
I20260812 09:51:23.007815 23478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:51:23.014945 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 23478
I20260812 09:51:23.015163 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:51:23.015496 11738 external_mini_cluster.cc:1428] Setting key d75724ad7e3e10bc5ced428fc14b80bb
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528282, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:23.025923 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.010120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:36065 (local address 127.11.118.190:38377)
0812 09:51:23.010308 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.010314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.011538 (+ 1224us) server_negotiation.cc:407] Connection header received
0812 09:51:23.013182 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.013186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.013256 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.013395 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:23.015149 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.015811 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.017392 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.017611 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.017729 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.021061 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:23.021069 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:23.021075 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:23.021113 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:23.023023 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.023692 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.023697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.023700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.023828 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.024393 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.024399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.024402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.024733 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:23.024860 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.025558 (+ 698us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.025715 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 09:51:23.026767 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.010548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38377 (local address 127.11.118.130:36065)
0812 09:51:23.011327 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.011379 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.012902 (+ 1523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.013602 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.013610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.014043 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:23.014872 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.014898 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.015964 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.015969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.017231 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.017243 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.017783 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.017787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.018036 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.018803 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:23.018822 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:23.020832 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:23.023190 (+ 2358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:23.023196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:23.023212 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:23.023539 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:23.024065 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:23.024069 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:23.024070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:23.024251 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:23.024935 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:23.024942 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:23.025240 (+ 298us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.025435 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.025748 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":141,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:51:23.028254 23630 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38377
I20260812 09:51:23.028535 23630 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:23.029140 23630 heartbeater.cc:511] Master 127.11.118.190:38377 requested a full tablet report, sending...
I20260812 09:51:23.030407 23257 ts_manager.cc:194] Registered new tserver with Master: d579089c5b7044fc89cb3f95a372fbf4 (127.11.118.130:36003)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:51:23.031358 23257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:36065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:51:23.052032 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:51:23.183099 23636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:51:23.183430 23636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:51:23.183478 23636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:51:23.188263 23636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:51:23.188370 23636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:51:23.188437 23636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:51:23.194411 23636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:51:23.195719 23636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:51:23.196791 23636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:51:23.207386 23642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:23.207585 23636 server_base.cc:1034] running on GCE node
W20260812 09:51:23.207436 23644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:51:23.207441 23641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:51:23.208279 23636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:51:23.209110 23636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:51:23.210354 23636 hybrid_clock.cc:648] HybridClock initialized: now 1786528283210342 us; error 35 us; skew 500 ppm
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528283, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:51:23.213759 23636 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:51:23.214768 23636 webserver.cc:460] Webserver started at http://127.11.118.131:37061/ using document root <none> and password file <none>
I20260812 09:51:23.215471 23636 fs_manager.cc:359] Metadata directory not provided
I20260812 09:51:23.215574 23636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:51:23.215837 23636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:51:23.218106 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "29bd59d4237949cca68d3175e8c3d3f4"
format_stamp: "Formatted at 2026-08-12 09:51:23 on dist-test-slave-2w3w"
server_key: "4e5e922f5090447af7aaf9b81c9efa21"
server_key_iv: "2dcbf959a56a3a581cb0e223b2a7fafe"
server_key_version: "encryptionkey@0"
I20260812 09:51:23.218768 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "29bd59d4237949cca68d3175e8c3d3f4"
format_stamp: "Formatted at 2026-08-12 09:51:23 on dist-test-slave-2w3w"
server_key: "4e5e922f5090447af7aaf9b81c9efa21"
server_key_iv: "2dcbf959a56a3a581cb0e223b2a7fafe"
server_key_version: "encryptionkey@0"
I20260812 09:51:23.223063 23636 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 09:51:23.225965 23652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:23.227674 23636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 09:51:23.227859 23636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "29bd59d4237949cca68d3175e8c3d3f4"
format_stamp: "Formatted at 2026-08-12 09:51:23 on dist-test-slave-2w3w"
server_key: "4e5e922f5090447af7aaf9b81c9efa21"
server_key_iv: "2dcbf959a56a3a581cb0e223b2a7fafe"
server_key_version: "encryptionkey@0"
I20260812 09:51:23.228006 23636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:51:23.239748 23636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:51:23.246866 23636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:51:23.247532 23636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:51:23.248638 23636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:51:23.250317 23636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:51:23.250453 23636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:23.250542 23636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:51:23.250589 23636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:51:23.262632 23636 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:34461
I20260812 09:51:23.262683 23780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:34461 every 8 connection(s)
I20260812 09:51:23.263754 23636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:51:23.272812 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 23636
I20260812 09:51:23.273015 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:51:23.273383 11738 external_mini_cluster.cc:1428] Setting key 6474b8057aba6e50dd80d39236b4d00b
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528283, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:51:23.281817 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.265936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:56867 (local address 127.11.118.190:38377)
0812 09:51:23.266132 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.266136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.267260 (+ 1124us) server_negotiation.cc:407] Connection header received
0812 09:51:23.268966 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.268969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.269023 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.269126 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:23.270832 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.271651 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.273227 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.273487 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.273634 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.277292 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:23.277296 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:23.277298 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:23.277328 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:23.279337 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.280021 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.280025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.280026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.280141 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.280583 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.280587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.280588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.280801 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:23.280890 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.281544 (+ 654us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.281667 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260812 09:51:23.282769 23784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.266383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38377 (local address 127.11.118.131:56867)
0812 09:51:23.267083 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.267136 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.268564 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.269355 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.269363 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.269986 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:51:23.270623 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.270641 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.271812 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.271818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.273071 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.273089 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.273762 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.273766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.273992 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.274688 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:51:23.274706 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:51:23.277011 (+ 2305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:51:23.279498 (+ 2487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:23.279505 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:23.279522 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:23.279888 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:23.280244 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:51:23.280247 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:51:23.280248 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:51:23.280448 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:51:23.280951 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:51:23.280957 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:51:23.281260 (+ 303us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.281455 (+ 195us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.281758 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":139,"threads_started":1}
I20260812 09:51:23.284248 23782 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38377
I20260812 09:51:23.284524 23782 heartbeater.cc:464] Registering TS with master...
I20260812 09:51:23.285070 23782 heartbeater.cc:511] Master 127.11.118.190:38377 requested a full tablet report, sending...
I20260812 09:51:23.286206 23257 ts_manager.cc:194] Registered new tserver with Master: 29bd59d4237949cca68d3175e8c3d3f4 (127.11.118.131:34461)
I20260812 09:51:23.286892 23257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:56867
I20260812 09:51:23.289130 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:51:23.301123 23304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.291719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.11.118.190:38377)
0812 09:51:23.291885 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.291890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.292135 (+ 245us) server_negotiation.cc:407] Connection header received
0812 09:51:23.292238 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.292240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.292287 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.292367 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:51:23.293228 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.293757 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.294681 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.294925 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.295111 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.296693 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:51:23.296697 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:51:23.296699 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:51:23.296776 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:51:23.298809 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.299499 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.299503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.299504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.299601 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:51:23.300004 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:51:23.300007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:51:23.300009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:51:23.300301 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:51:23.300429 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.300771 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.300899 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:51:23.305361 23257 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:51:23.308835 23257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:51:23.326884 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.318849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:36003 (local address 127.0.0.1:40544)
0812 09:51:23.319752 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.319812 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.319960 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.320870 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.320876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.320904 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:51:23.321073 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.321081 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323514 (+ 2433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.323520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.325511 (+ 1991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.325520 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.326507 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.326605 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.326629 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.326684 (+ 55us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.326736 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":111,"thread_start_us":119,"threads_started":1}
I20260812 09:51:23.326813 23798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.319106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:45931 (local address 127.0.0.1:53496)
0812 09:51:23.319867 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.319886 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.319989 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.320958 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.320962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.320981 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:51:23.321098 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.321106 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323533 (+ 2427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.323535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.324916 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.324928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.326140 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.326290 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.326344 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.326479 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.326634 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":188,"thread_start_us":121,"threads_started":1}
I20260812 09:51:23.327358 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.319239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:34461 (local address 127.0.0.1:49152)
0812 09:51:23.320196 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.320209 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.320299 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.321629 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.321633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.321651 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:51:23.321750 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.321756 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323883 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.323886 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.324853 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.324865 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.326383 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.326503 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.326542 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.326618 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.326711 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260812 09:51:23.327736 23795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.319062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40544 (local address 127.11.118.130:36003)
0812 09:51:23.320295 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.320307 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.320332 (+ 25us) server_negotiation.cc:407] Connection header received
0812 09:51:23.320455 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.320461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.320691 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.320872 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:51:23.321220 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323318 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.325652 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.326380 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326532 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.327369 (+ 837us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.327435 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.327572 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1121,"thread_start_us":149,"threads_started":1}
I20260812 09:51:23.327852 23799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.319745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49152 (local address 127.11.118.131:34461)
0812 09:51:23.321232 (+ 1487us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.321251 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.321269 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:51:23.321353 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.321357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.321496 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.321651 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:51:23.321889 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323692 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.325055 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.325979 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326132 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.326287 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.326916 (+ 629us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.327647 (+ 731us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1373,"thread_start_us":156,"threads_started":1}
I20260812 09:51:23.327997 23800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.320172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.11.118.129:45931)
0812 09:51:23.320537 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.320541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.320559 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:51:23.320649 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.320654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.320825 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.320978 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:51:23.321287 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.323358 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.325073 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.325979 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.326131 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.326297 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.327695 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.327828 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":135,"threads_started":1}
I20260812 09:51:23.330695 23708 tablet_service.cc:1467] Processing CreateTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 (DEFAULT_TABLE table=test-table [id=6e623f9cda7d49ccb86212fff9ffd9a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:51:23.330770 23553 tablet_service.cc:1467] Processing CreateTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 (DEFAULT_TABLE table=test-table [id=6e623f9cda7d49ccb86212fff9ffd9a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:51:23.330770 23392 tablet_service.cc:1467] Processing CreateTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 (DEFAULT_TABLE table=test-table [id=6e623f9cda7d49ccb86212fff9ffd9a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:51:23.332274 23708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f869a4a3ba345c89325f9a82dd5da30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:23.332466 23392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f869a4a3ba345c89325f9a82dd5da30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:23.332494 23553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f869a4a3ba345c89325f9a82dd5da30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:51:23.339906 23801 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Bootstrap starting.
I20260812 09:51:23.341396 23802 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: Bootstrap starting.
I20260812 09:51:23.341405 23803 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Bootstrap starting.
I20260812 09:51:23.342483 23801 tablet_bootstrap.cc:654] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:23.343822 23802 tablet_bootstrap.cc:654] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:23.343963 23801 log.cc:824] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:23.344271 23803 tablet_bootstrap.cc:654] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Neither blocks nor log segments found. Creating new log.
I20260812 09:51:23.344770 23802 log.cc:824] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:23.345108 23803 log.cc:824] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Log is configured to *not* fsync() on all Append() calls
I20260812 09:51:23.346333 23801 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: No bootstrap required, opened a new log
I20260812 09:51:23.346557 23801 ts_tablet_manager.cc:1397] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:51:23.346838 23802 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: No bootstrap required, opened a new log
I20260812 09:51:23.347071 23802 ts_tablet_manager.cc:1397] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:51:23.347163 23803 tablet_bootstrap.cc:492] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: No bootstrap required, opened a new log
I20260812 09:51:23.347357 23803 ts_tablet_manager.cc:1397] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:51:23.350777 23802 raft_consensus.cc:348] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.351148 23802 raft_consensus.cc:374] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:23.351218 23802 raft_consensus.cc:729] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618222dc1f4548b1a8da3a61aff34164, State: Initialized, Role: FOLLOWER
I20260812 09:51:23.351305 23803 raft_consensus.cc:348] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.351599 23803 raft_consensus.cc:374] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:23.351665 23803 raft_consensus.cc:729] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d579089c5b7044fc89cb3f95a372fbf4, State: Initialized, Role: FOLLOWER
I20260812 09:51:23.351850 23802 consensus_queue.cc:260] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.352113 23803 consensus_queue.cc:260] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.352061 23801 raft_consensus.cc:348] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.352322 23801 raft_consensus.cc:374] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:51:23.352222 23807 raft_consensus.cc:482] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:51:23.352392 23801 raft_consensus.cc:729] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bd59d4237949cca68d3175e8c3d3f4, State: Initialized, Role: FOLLOWER
I20260812 09:51:23.352545 23807 raft_consensus.cc:504] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.352866 23801 consensus_queue.cc:260] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.353089 23802 ts_tablet_manager.cc:1428] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:51:23.353142 23803 ts_tablet_manager.cc:1428] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:51:23.353509 23473 heartbeater.cc:503] Master 127.11.118.190:38377 was elected leader, sending a full tablet report...
I20260812 09:51:23.353509 23630 heartbeater.cc:503] Master 127.11.118.190:38377 was elected leader, sending a full tablet report...
I20260812 09:51:23.353793 23801 ts_tablet_manager.cc:1428] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 09:51:23.354166 23782 heartbeater.cc:503] Master 127.11.118.190:38377 was elected leader, sending a full tablet report...
I20260812 09:51:23.355327 23807 leader_election.cc:288] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d579089c5b7044fc89cb3f95a372fbf4 (127.11.118.130:36003), 29bd59d4237949cca68d3175e8c3d3f4 (127.11.118.131:34461)
I20260812 09:51:23.361521 23795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.355991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:41813 (local address 127.11.118.130:36003)
0812 09:51:23.356163 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.356171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.356698 (+ 527us) server_negotiation.cc:407] Connection header received
0812 09:51:23.356937 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.356940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.356992 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.357041 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:51:23.357579 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.358310 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.360093 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.360724 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.360812 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.360864 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.361248 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.361341 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 09:51:23.361635 23799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.356628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:45077 (local address 127.11.118.131:34461)
0812 09:51:23.356753 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.356757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.356937 (+ 180us) server_negotiation.cc:407] Connection header received
0812 09:51:23.357132 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.357136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.357186 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.357235 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:51:23.358321 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.359121 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.360499 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.361099 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.361205 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.361258 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.361431 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.361504 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:51:23.361629 23813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.356259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:34461 (local address 127.11.118.129:45077)
0812 09:51:23.356797 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.356853 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.357009 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.358053 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.358057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.358073 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:51:23.358193 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.358198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.359262 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.359265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.360365 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.360374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.361212 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.361214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.361306 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.361326 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.361389 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.361450 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":100,"threads_started":1}
I20260812 09:51:23.361943 23812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.355584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:36003 (local address 127.11.118.129:41813)
0812 09:51:23.356597 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.356613 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:51:23.356798 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:51:23.357205 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:51:23.357208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:51:23.357224 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:51:23.357389 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.357399 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.358587 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.358591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.359934 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:51:23.359956 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.360973 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.360977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:51:23.361096 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.361123 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:51:23.361698 (+ 575us) client_negotiation.cc:240] Negotiation successful
0812 09:51:23.361793 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":941,"thread_start_us":100,"threads_started":1}
I20260812 09:51:23.362272 23730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f869a4a3ba345c89325f9a82dd5da30" candidate_uuid: "618222dc1f4548b1a8da3a61aff34164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29bd59d4237949cca68d3175e8c3d3f4" is_pre_election: true
I20260812 09:51:23.362555 23730 raft_consensus.cc:2454] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618222dc1f4548b1a8da3a61aff34164 in term 0.
I20260812 09:51:23.363057 23351 leader_election.cc:302] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29bd59d4237949cca68d3175e8c3d3f4, 618222dc1f4548b1a8da3a61aff34164; no voters:
I20260812 09:51:23.363348 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f869a4a3ba345c89325f9a82dd5da30" candidate_uuid: "618222dc1f4548b1a8da3a61aff34164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d579089c5b7044fc89cb3f95a372fbf4" is_pre_election: true
I20260812 09:51:23.363457 23808 raft_consensus.cc:2781] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:51:23.363559 23808 raft_consensus.cc:482] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:51:23.363615 23808 raft_consensus.cc:3037] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:23.363646 23577 raft_consensus.cc:2454] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618222dc1f4548b1a8da3a61aff34164 in term 0.
I20260812 09:51:23.364852 23808 raft_consensus.cc:504] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.365227 23808 leader_election.cc:288] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [CANDIDATE]: Term 1 election: Requested vote from peers d579089c5b7044fc89cb3f95a372fbf4 (127.11.118.130:36003), 29bd59d4237949cca68d3175e8c3d3f4 (127.11.118.131:34461)
I20260812 09:51:23.365644 23730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f869a4a3ba345c89325f9a82dd5da30" candidate_uuid: "618222dc1f4548b1a8da3a61aff34164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29bd59d4237949cca68d3175e8c3d3f4"
I20260812 09:51:23.365658 23577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f869a4a3ba345c89325f9a82dd5da30" candidate_uuid: "618222dc1f4548b1a8da3a61aff34164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d579089c5b7044fc89cb3f95a372fbf4"
I20260812 09:51:23.365801 23730 raft_consensus.cc:3037] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:23.365800 23577 raft_consensus.cc:3037] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:51:23.367352 23730 raft_consensus.cc:2454] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618222dc1f4548b1a8da3a61aff34164 in term 1.
I20260812 09:51:23.367352 23577 raft_consensus.cc:2454] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618222dc1f4548b1a8da3a61aff34164 in term 1.
I20260812 09:51:23.367695 23348 leader_election.cc:302] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618222dc1f4548b1a8da3a61aff34164, d579089c5b7044fc89cb3f95a372fbf4; no voters:
I20260812 09:51:23.367899 23808 raft_consensus.cc:2781] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:51:23.368005 23808 raft_consensus.cc:686] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [term 1 LEADER]: Becoming Leader. State: Replica: 618222dc1f4548b1a8da3a61aff34164, State: Running, Role: LEADER
I20260812 09:51:23.368369 23808 consensus_queue.cc:237] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } }
I20260812 09:51:23.372294 23258 catalog_manager.cc:5495] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618222dc1f4548b1a8da3a61aff34164 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "618222dc1f4548b1a8da3a61aff34164" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618222dc1f4548b1a8da3a61aff34164" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 } health_report { overall_health: UNKNOWN } } }
I20260812 09:51:23.393918 23800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.389943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.11.118.129:45931)
0812 09:51:23.390083 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 09:51:23.390088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:51:23.390104 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:51:23.390203 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:51:23.390205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:51:23.390308 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:51:23.390418 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:51:23.390681 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.391405 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.392354 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:51:23.392606 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:51:23.392700 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:51:23.393042 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:51:23.393524 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:51:23.393619 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 09:51:23.393730 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 09:51:23.393790 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 09:51:23.400676 23730 raft_consensus.cc:1261] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 1 FOLLOWER]: Refusing update from remote peer 618222dc1f4548b1a8da3a61aff34164: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:51:23.400705 23577 raft_consensus.cc:1261] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 1 FOLLOWER]: Refusing update from remote peer 618222dc1f4548b1a8da3a61aff34164: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:51:23.401611 23807 consensus_queue.cc:1035] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29bd59d4237949cca68d3175e8c3d3f4" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:51:23.401846 23808 consensus_queue.cc:1035] T 8f869a4a3ba345c89325f9a82dd5da30 P 618222dc1f4548b1a8da3a61aff34164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d579089c5b7044fc89cb3f95a372fbf4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 36003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:51:23.419524 23257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:51:23.419756 23257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:51:23.422765 23257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 669d771daf0144488b73e10852bc90e4: Sending DeleteTablet for 3 replicas of tablet 8f869a4a3ba345c89325f9a82dd5da30
I20260812 09:51:23.423781 23708 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:51:23 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:49152
I20260812 09:51:23.423791 23553 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:51:23 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:40544
I20260812 09:51:23.423776 23392 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f869a4a3ba345c89325f9a82dd5da30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:51:23 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:53496
I20260812 09:51:23.424444 23830 tablet_replica.cc:330] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: stopping tablet replica
I20260812 09:51:23.424580 23828 tablet_replica.cc:330] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: stopping tablet replica
I20260812 09:51:23.424934 23830 raft_consensus.cc:2229] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:51:23.425076 23828 raft_consensus.cc:2229] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:51:23.425372 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 23329
I20260812 09:51:23.425479 23830 raft_consensus.cc:2258] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:51:23.427994 23830 ts_tablet_manager.cc:1905] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:51:23.425426 23828 raft_consensus.cc:2258] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:51:23.430328 23828 ts_tablet_manager.cc:1905] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:51:23.431133 23830 ts_tablet_manager.cc:1918] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:51:23.431249 23830 log.cc:1196] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/8f869a4a3ba345c89325f9a82dd5da30
I20260812 09:51:23.431609 23830 ts_tablet_manager.cc:1939] T 8f869a4a3ba345c89325f9a82dd5da30 P d579089c5b7044fc89cb3f95a372fbf4: Deleting consensus metadata
I20260812 09:51:23.433223 23244 catalog_manager.cc:4841] TS d579089c5b7044fc89cb3f95a372fbf4 (127.11.118.130:36003): tablet 8f869a4a3ba345c89325f9a82dd5da30 (table test-table [id=6e623f9cda7d49ccb86212fff9ffd9a5]) successfully deleted
I20260812 09:51:23.433353 23828 ts_tablet_manager.cc:1918] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:51:23.433454 23828 log.cc:1196] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/8f869a4a3ba345c89325f9a82dd5da30
I20260812 09:51:23.433779 23828 ts_tablet_manager.cc:1939] T 8f869a4a3ba345c89325f9a82dd5da30 P 29bd59d4237949cca68d3175e8c3d3f4: Deleting consensus metadata
I20260812 09:51:23.434930 23247 catalog_manager.cc:4841] TS 29bd59d4237949cca68d3175e8c3d3f4 (127.11.118.131:34461): tablet 8f869a4a3ba345c89325f9a82dd5da30 (table test-table [id=6e623f9cda7d49ccb86212fff9ffd9a5]) successfully deleted
W20260812 09:51:23.437088 23246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:45931 (error 108)
I20260812 09:51:23.438021 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 23478
I20260812 09:51:23.438331 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:51:23.438012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:45931 (local address 127.0.0.1:53510)
0812 09:51:23.438152 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 09:51:23.438229 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:45931: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 09:51:23.443233 23246 catalog_manager.cc:4584] TS 618222dc1f4548b1a8da3a61aff34164 (127.11.118.129:45931): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f869a4a3ba345c89325f9a82dd5da30: Network error: Client connection negotiation failed: client connection to 127.11.118.129:45931: connect: Connection refused (error 111)
I20260812 09:51:23.446223 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 23636
I20260812 09:51:23.457343 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 23224
2026-08-12T09:51:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2527 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23838](info): set up 2 sockets
Aug 12 09:51:23 dist-test-slave-2w3w krb5kdc[23838](info): commencing operation
krb5kdc: starting...
W20260812 09:51:24.612437 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:51:24 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:51:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:51:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangeradmin_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangeradmin_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangerlookup_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangerlookup_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
I20260812 09:51:24.818298 11738 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskilB4wR/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/postgres -l logfile start
2026-08-12 09:51:27.868 UTC [23873] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 09:51:27.868 UTC [23873] LOG: listening on IPv4 address "127.11.118.148", port 40363
2026-08-12 09:51:27.874 UTC [23873] LOG: listening on Unix socket "/tmp/.s.PGSQL.40363"
2026-08-12 09:51:27.913 UTC [23876] LOG: database system was shut down at 2026-08-12 09:51:26 UTC
2026-08-12 09:51:27.918 UTC [23873] LOG: database system is ready to accept connections
I20260812 09:51:28.934850 11738 mini_postgres.cc:96] Postgres bound to 40363
2026-08-12 09:51:28.943 UTC [23884] FATAL: database "slave" does not exist
127.11.118.148:40363 - accepting connections
I20260812 09:51:28.944662 11738 mini_ranger.cc:161] Starting Ranger...
I20260812 09:51:28.963876 11738 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 09:51:29.597129 11738 mini_ranger.cc:87] Created ranger Postgres database
I20260812 09:51:29.597245 11738 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin
2026-08-12 09:51:29,942 [I] DB FLAVOR :POSTGRES
2026-08-12 09:51:29,942 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 09:51:29,942 [I] Checking connection..
2026-08-12 09:51:29,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 09:51:30,233 [I] Checking connection passed.
2026-08-12 09:51:30,233 [I] --------- Verifying version history table ---------
2026-08-12 09:51:30,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:51:30,523 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 09:51:30,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:51:30,790 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 09:51:30,790 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 09:51:30,791 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 09:51:31.067 UTC [23955] WARNING: there is no transaction in progress
2026-08-12 09:51:31,075 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 09:51:31,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:51:31,341 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 09:51:31,341 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 09:51:31,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 09:51:31,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 09:51:31,871 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-12 09:51:32,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 09:51:32,444 [I] Table x_portal_user does not exist in database ranger
2026-08-12 09:51:32,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 09:51:32,723 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 09:51:32,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 09:51:33,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 09:51:33,296 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 09:51:33,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 09:51:34.464 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.484 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.504 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.522 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.543 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.566 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.640 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.650 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.668 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.680 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.693 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.709 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.721 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.729 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.738 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:34.747 UTC [24075] WARNING: there is no transaction in progress
2026-08-12 09:51:35,623 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 09:51:35,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 09:51:35,879 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 09:51:35,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 09:51:36,168 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 09:51:36,169 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 09:51:36,456 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 09:51:36,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 09:51:36,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 09:51:37,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-12 09:51:37,296 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 09:51:37,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 09:51:37,593 [I] DB_PATCHES have already been applied
I20260812 09:51:37.600955 11738 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskilB4wR/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 09:51:37.601084 11738 mini_ranger.cc:193] Using host: 127.11.118.148
I20260812 09:51:37.606194 11738 mini_ranger.cc:227] Ranger admin URL: http://127.11.118.148:38805
Aug 12, 2026 9:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:51:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 9:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 9:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 9:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 9:51:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 09:51:38.841784 11738 mini_ranger.cc:160] Time spent starting Ranger: real 9.897s user 0.000s sys 0.015s
Aug 12, 2026 9:52:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 9:52:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIs
Aug 12, 2026 9:52:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 9:52:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 9:52:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 09:52:04.077440 11738 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangerkms_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/rangerkms_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.118.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.118.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 09:52:04 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528324, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 09:52:04.196436 11738 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 09:52:04.212281 11738 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 09:52:05.386161 11738 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 09:52:05.386267 11738 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms
I20260812 09:52:05.386382 11738 mini_ranger_kms.cc:227] Using postgres at 127.11.118.148:40363
2026-08-12 09:52:05,624 [I] DB FLAVOR :POSTGRES
2026-08-12 09:52:05,625 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 09:52:05,625 [I] Checking connection
2026-08-12 09:52:05,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 09:52:05,911 [I] connection success
2026-08-12 09:52:05,911 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 09:52:05,912 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 09:52:05,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 09:52:06,186 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 09:52:06,186 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 09:52:06,186 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 09:52:06,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:40363/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 09:52:06,486 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 09:52:07.060808 11738 mini_ranger_kms.cc:310] Created kms service
I20260812 09:52:07.271579 11738 mini_ranger_kms.cc:326] Created kudu user
I20260812 09:52:07.327735 11738 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 09:52:07 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528324, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:07.816002 11738 mini_ranger_kms.cc:384] Added ranger policy
I20260812 09:52:07.816184 11738 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms:/tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 09:52:07.816212 11738 mini_ranger_kms.cc:240] Using host: 127.11.118.148
I20260812 09:52:07.821223 11738 mini_ranger_kms.cc:276] Ranger KMS PID: 24282
I20260812 09:52:07.821395 11738 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.118.148:39787
Aug 12, 2026 9:52:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:52:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:52:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 9:52:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 9:52:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 9:52:09 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 09:52:10 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786528330, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:52:10.275764 11738 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.079s user 0.000s sys 0.223s
I20260812 09:52:10.275892 11738 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 09:52:10.276033 11738 mini_ranger_kms.cc:401] 127.11.118.148:39787/kms/v1/keys
Aug 12 09:52:10 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528330, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
Aug 12 09:52:11 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528330, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
Aug 12 09:52:13 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:52:13.643776 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41765
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:32881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:41765
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:39787/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:52:13.763963 24341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:52:13.764276 24341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:52:13.764324 24341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:52:13.768743 24341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:52:13.768841 24341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:52:13.768862 24341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:52:13.768878 24341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:52:13.768894 24341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:52:13.775038 24341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.118.148:39787/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:41765
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:52:13.776243 24341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:52:13.777340 24341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:52:13.787266 24346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:13.787377 24347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:13.787329 24341 server_base.cc:1034] running on GCE node
W20260812 09:52:13.787423 24350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:13.788275 24341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:52:13.789609 24341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:52:13.790820 24341 hybrid_clock.cc:648] HybridClock initialized: now 1786528333790731 us; error 109 us; skew 500 ppm
Aug 12 09:52:13 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:52:13.794493 24341 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:52:13.795723 24341 webserver.cc:460] Webserver started at http://127.11.118.190:46683/ using document root <none> and password file <none>
I20260812 09:52:13.796343 24341 fs_manager.cc:359] Metadata directory not provided
I20260812 09:52:13.796432 24341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:52:13.796677 24341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:52:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528333, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:13.847573 24341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "63b097316b1b4656b7333128399e4107"
format_stamp: "Formatted at 2026-08-12 09:52:13 on dist-test-slave-2w3w"
server_key: "2052083c4ca8ee6b9ae63447f28aeb92"
server_key_iv: "114728529bdf17d0f9825bd96f561522"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:13.848259 24341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "63b097316b1b4656b7333128399e4107"
format_stamp: "Formatted at 2026-08-12 09:52:13 on dist-test-slave-2w3w"
server_key: "2052083c4ca8ee6b9ae63447f28aeb92"
server_key_iv: "114728529bdf17d0f9825bd96f561522"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:13.852630 24341 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:52:13.868682 24357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:13.870265 24341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:52:13.870458 24341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "63b097316b1b4656b7333128399e4107"
format_stamp: "Formatted at 2026-08-12 09:52:13 on dist-test-slave-2w3w"
server_key: "2052083c4ca8ee6b9ae63447f28aeb92"
server_key_iv: "114728529bdf17d0f9825bd96f561522"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:13.870676 24341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:52:13.888999 24341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:52:13.892699 24341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:52:13.892948 24341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:52:13.901841 24341 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:41765
I20260812 09:52:13.901911 24413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:41765 every 8 connection(s)
I20260812 09:52:13.903030 24341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:52:13.903581 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 24341
I20260812 09:52:13.903728 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:52:13.904101 11738 external_mini_cluster.cc:1428] Setting key 0a7822166682c441b0cc1e6dd8a0c1b8
I20260812 09:52:13.906309 24414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:52:13.913710 24414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: Bootstrap starting.
Aug 12 09:52:13 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:52:13.916721 24414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: Neither blocks nor log segments found. Creating new log.
I20260812 09:52:13.917994 24414 log.cc:824] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: Log is configured to *not* fsync() on all Append() calls
I20260812 09:52:13.920713 24414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: No bootstrap required, opened a new log
I20260812 09:52:13.921589 24417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:13.905805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.11.118.190:41765)
0812 09:52:13.906296 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:13.906325 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:13.906394 (+ 69us) server_negotiation.cc:407] Connection header received
0812 09:52:13.907249 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:13.907270 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:13.907632 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:13.907958 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:52:13.908983 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:13.910192 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:13.911514 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:13.912066 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:13.912204 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:13.915839 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:52:13.915846 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:52:13.915861 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:52:13.915922 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:52:13.918063 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:13.918701 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:13.918707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:13.918712 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:13.918838 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:13.919260 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:13.919264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:13.919266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:13.919803 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:52:13.920019 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:13.920298 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 09:52:13.920597 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":168,"threads_started":1}
I20260812 09:52:13.924288 24414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } }
I20260812 09:52:13.924559 24414 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:52:13.924623 24414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63b097316b1b4656b7333128399e4107, State: Initialized, Role: FOLLOWER
I20260812 09:52:13.925060 24414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } }
I20260812 09:52:13.925182 24414 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:52:13.925253 24414 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:52:13.925367 24414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:52:13.926554 24414 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } }
I20260812 09:52:13.926936 24414 leader_election.cc:302] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63b097316b1b4656b7333128399e4107; no voters:
I20260812 09:52:13.927333 24414 leader_election.cc:288] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:52:13.927549 24419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:52:13.927944 24419 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [term 1 LEADER]: Becoming Leader. State: Replica: 63b097316b1b4656b7333128399e4107, State: Running, Role: LEADER
I20260812 09:52:13.928272 24419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } }
I20260812 09:52:13.928637 24414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:52:13.930159 24422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63b097316b1b4656b7333128399e4107. Latest consensus state: current_term: 1 leader_uuid: "63b097316b1b4656b7333128399e4107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } } }
I20260812 09:52:13.930330 24422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [sys.catalog]: This master's current role is: LEADER
I20260812 09:52:13.930680 24420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63b097316b1b4656b7333128399e4107" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63b097316b1b4656b7333128399e4107" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41765 } } }
I20260812 09:52:13.930730 24433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:52:13.930758 24420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107 [sys.catalog]: This master's current role is: LEADER
I20260812 09:52:13.931181 24414 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 09:52:13.937093 24433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:52:13.943755 24433 catalog_manager.cc:1347] Generated new cluster ID: 02187fa5f04544efb4547bdef2edbe2b
I20260812 09:52:13.943843 24433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:52:13.955737 24433 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:52:13.957244 24433 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:52:13.963317 24433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: Generated new TSK 0
I20260812 09:52:13.964299 24433 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:52:14.728080 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:39787/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:32881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:52:14.862097 24468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:52:14.862473 24468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:52:14.862587 24468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:52:14.867410 24468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:52:14.867513 24468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:52:14.867614 24468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:52:14.873849 24468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.118.148:39787/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:52:14.875614 24468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:52:14.877125 24468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:52:14.889540 24479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:14.889720 24468 server_base.cc:1034] running on GCE node
W20260812 09:52:14.889894 24477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:14.890026 24476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:14.890560 24468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:52:14.891397 24468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:52:14.894765 24468 hybrid_clock.cc:648] HybridClock initialized: now 1786528334894703 us; error 132 us; skew 500 ppm
Aug 12 09:52:14 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:52:14.902598 24468 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:52:14.903751 24468 webserver.cc:460] Webserver started at http://127.11.118.129:45057/ using document root <none> and password file <none>
I20260812 09:52:14.904363 24468 fs_manager.cc:359] Metadata directory not provided
I20260812 09:52:14.904469 24468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:52:14.904726 24468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:52:14 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:14.922726 24468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08"
format_stamp: "Formatted at 2026-08-12 09:52:14 on dist-test-slave-2w3w"
server_key: "5928362d1ab35387d8a628fd58bf1d07"
server_key_iv: "1d5bb2d0e73a0c53e077aaaa40073994"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:14.923607 24468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08"
format_stamp: "Formatted at 2026-08-12 09:52:14 on dist-test-slave-2w3w"
server_key: "5928362d1ab35387d8a628fd58bf1d07"
server_key_iv: "1d5bb2d0e73a0c53e077aaaa40073994"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:14.932406 24468 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260812 09:52:14.959625 24486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:14.961730 24468 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.004s sys 0.000s
I20260812 09:52:14.962044 24468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08"
format_stamp: "Formatted at 2026-08-12 09:52:14 on dist-test-slave-2w3w"
server_key: "5928362d1ab35387d8a628fd58bf1d07"
server_key_iv: "1d5bb2d0e73a0c53e077aaaa40073994"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:14.962584 24468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:52:14.979676 24468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:52:14.992437 24468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:52:14.992753 24468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:52:14.993605 24468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:52:14.994951 24468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:52:14.995110 24468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 09:52:14.995247 24468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:52:14.995347 24468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.008272 24468 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:43741
I20260812 09:52:15.008338 24620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:43741 every 8 connection(s)
I20260812 09:52:15.009721 24468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:52:15.012037 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 24468
I20260812 09:52:15.012184 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:52:15.012539 11738 external_mini_cluster.cc:1428] Setting key 73021c07309979adf28c02d77295372d
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528334, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:52:15.040262 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.013567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:35383 (local address 127.11.118.190:41765)
0812 09:52:15.013870 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.013875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.017791 (+ 3916us) server_negotiation.cc:407] Connection header received
0812 09:52:15.020989 (+ 3198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.020994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.021080 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.021165 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:52:15.023292 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.024225 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.026203 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.026577 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.026669 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.031134 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:52:15.031139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:52:15.031142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:52:15.031183 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:52:15.033293 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.036305 (+ 3012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.036313 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.036316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.036600 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.037673 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.037677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.037680 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.037985 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:52:15.038106 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.039876 (+ 1770us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.040055 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":112,"threads_started":1}
I20260812 09:52:15.042918 24625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.014189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41765 (local address 127.11.118.129:35383)
0812 09:52:15.017547 (+ 3358us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.017640 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.018940 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.021733 (+ 2793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.021746 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.022221 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:52:15.023066 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.023091 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.024422 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.024425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.026020 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.026035 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.026990 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.026995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.027215 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.028021 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:52:15.028048 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:52:15.030189 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:52:15.033511 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.033519 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.033541 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.034024 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.036797 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.036800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.036802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.037318 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.039070 (+ 1752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:52:15.039080 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:52:15.039509 (+ 429us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.040949 (+ 1440us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.041417 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3051,"thread_start_us":179,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:52:15.059316 24621 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41765
I20260812 09:52:15.059646 24621 heartbeater.cc:464] Registering TS with master...
I20260812 09:52:15.060349 24621 heartbeater.cc:511] Master 127.11.118.190:41765 requested a full tablet report, sending...
I20260812 09:52:15.062533 24375 ts_manager.cc:194] Registered new tserver with Master: 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 (127.11.118.129:43741)
I20260812 09:52:15.064229 24375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:35383
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:52:15.095439 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:39787/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:32881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 09:52:15.269213 24630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:52:15.270125 24630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:52:15.270267 24630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:52:15.276685 24630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:52:15.276789 24630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:52:15.276891 24630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:52:15.285399 24630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.118.148:39787/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:52:15.287204 24630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:52:15.288565 24630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:52:15.301599 24640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:15.301724 24638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:15.301586 24637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:15.302201 24630 server_base.cc:1034] running on GCE node
I20260812 09:52:15.302912 24630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:52:15.303915 24630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:52:15.305140 24630 hybrid_clock.cc:648] HybridClock initialized: now 1786528335305111 us; error 48 us; skew 500 ppm
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:52:15.310050 24630 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:52:15.311463 24630 webserver.cc:460] Webserver started at http://127.11.118.130:41197/ using document root <none> and password file <none>
I20260812 09:52:15.312335 24630 fs_manager.cc:359] Metadata directory not provided
I20260812 09:52:15.312501 24630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:52:15.312822 24630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:15.331961 24630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "e204224d1a9d4bf491075167af5b72c9"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "7a0eb890513a6389588e6f85e8fc16aa"
server_key_iv: "d162d5d78ce83f31a48064963bf960ea"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.333001 24630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "e204224d1a9d4bf491075167af5b72c9"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "7a0eb890513a6389588e6f85e8fc16aa"
server_key_iv: "d162d5d78ce83f31a48064963bf960ea"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.339043 24630 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260812 09:52:15.360291 24648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.362280 24630 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260812 09:52:15.362470 24630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "e204224d1a9d4bf491075167af5b72c9"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "7a0eb890513a6389588e6f85e8fc16aa"
server_key_iv: "d162d5d78ce83f31a48064963bf960ea"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.362640 24630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:52:15.382918 24630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:52:15.387283 24630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:52:15.387590 24630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:52:15.388438 24630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:52:15.389683 24630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:52:15.389806 24630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.389921 24630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:52:15.390000 24630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.405375 24630 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:33577
I20260812 09:52:15.406806 24630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:52:15.407999 24781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:33577 every 8 connection(s)
I20260812 09:52:15.415078 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 24630
I20260812 09:52:15.415246 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:52:15.415599 11738 external_mini_cluster.cc:1428] Setting key 502492ba7b1049a372a445afc2d63c80
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:52:15.428746 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.411202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:48775 (local address 127.11.118.190:41765)
0812 09:52:15.411346 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.411352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.413129 (+ 1777us) server_negotiation.cc:407] Connection header received
0812 09:52:15.414607 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.414612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.414677 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.414767 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:52:15.416770 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.417634 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.419557 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.419946 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.420031 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.423710 (+ 3679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:52:15.423715 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:52:15.423718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:52:15.423753 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:52:15.425775 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.426596 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.426600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.426603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.426702 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.427195 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.427199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.427201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.427476 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:52:15.427576 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.428375 (+ 799us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.428557 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:52:15.430948 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.411488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41765 (local address 127.11.118.130:48775)
0812 09:52:15.412924 (+ 1436us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.412993 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.414251 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.415307 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.415317 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.415800 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:52:15.416577 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.416600 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.417808 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.417812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.419379 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.419392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.420286 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.420291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.420531 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.421302 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:52:15.421326 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:52:15.423446 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:52:15.425965 (+ 2519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.425973 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.425995 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.426440 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.426817 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.426820 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.426822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.427066 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.427656 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:52:15.427664 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:52:15.428049 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.429320 (+ 1271us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.429757 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1192,"thread_start_us":188,"threads_started":1}
I20260812 09:52:15.433856 24783 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41765
I20260812 09:52:15.434239 24783 heartbeater.cc:464] Registering TS with master...
I20260812 09:52:15.435178 24783 heartbeater.cc:511] Master 127.11.118.190:41765 requested a full tablet report, sending...
I20260812 09:52:15.436663 24375 ts_manager.cc:194] Registered new tserver with Master: e204224d1a9d4bf491075167af5b72c9 (127.11.118.130:33577)
I20260812 09:52:15.437480 24375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:48775
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:52:15.492408 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:39787/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:32881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:52:15.675552 24789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:52:15.676278 24789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:52:15.676534 24789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:52:15.683880 24789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:52:15.684058 24789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:52:15.684221 24789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:52:15.694940 24789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.118.148:39787/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:52:15.696952 24789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:52:15.698645 24789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:52:15.721375 24795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:15.721350 24798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:52:15.721350 24794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:52:15.722738 24789 server_base.cc:1034] running on GCE node
I20260812 09:52:15.723383 24789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:52:15.724275 24789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:52:15.727628 24789 hybrid_clock.cc:648] HybridClock initialized: now 1786528335727596 us; error 43 us; skew 500 ppm
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:52:15.731868 24789 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:52:15.733078 24789 webserver.cc:460] Webserver started at http://127.11.118.131:35139/ using document root <none> and password file <none>
I20260812 09:52:15.733903 24789 fs_manager.cc:359] Metadata directory not provided
I20260812 09:52:15.733992 24789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:52:15.734225 24789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:15.772645 24789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "e673d35f9214430bb51e1f5d6f629b7f"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "5f7f5ca18d48f331bc85b6210ce07467"
server_key_iv: "d4b53b1eb504049f9aa4860ebfed80a7"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.774690 24789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "e673d35f9214430bb51e1f5d6f629b7f"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "5f7f5ca18d48f331bc85b6210ce07467"
server_key_iv: "d4b53b1eb504049f9aa4860ebfed80a7"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.804980 24789 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.005s sys 0.000s
I20260812 09:52:15.835582 24805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.837543 24789 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.001s sys 0.000s
I20260812 09:52:15.837723 24789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "e673d35f9214430bb51e1f5d6f629b7f"
format_stamp: "Formatted at 2026-08-12 09:52:15 on dist-test-slave-2w3w"
server_key: "5f7f5ca18d48f331bc85b6210ce07467"
server_key_iv: "d4b53b1eb504049f9aa4860ebfed80a7"
server_key_version: "kuduclusterkey@0"
I20260812 09:52:15.837888 24789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:52:15.861747 24789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:52:15.865329 24789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:52:15.865566 24789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:52:15.866297 24789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:52:15.867293 24789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:52:15.867373 24789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.867478 24789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:52:15.867532 24789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:52:15.879732 24789 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:43015
I20260812 09:52:15.879751 24935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:43015 every 8 connection(s)
I20260812 09:52:15.880906 24789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:52:15.881718 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 24789
I20260812 09:52:15.881868 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:52:15.882193 11738 external_mini_cluster.cc:1428] Setting key 7555768ba762d91b96af9c0b26ca5e4d
Aug 12 09:52:15 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:52:15.899780 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.885818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:56799 (local address 127.11.118.190:41765)
0812 09:52:15.886291 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.886296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.886314 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:52:15.886734 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.886738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.886792 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.886896 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:52:15.888429 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.889262 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.891090 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.891453 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.891562 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.894998 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:52:15.895004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:52:15.895007 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:52:15.895041 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:52:15.896925 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.897711 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.897716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.897718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.897828 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.898305 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.898309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.898310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.898558 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:52:15.898633 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.899453 (+ 820us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.899603 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381}
I20260812 09:52:15.901117 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.884793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41765 (local address 127.11.118.131:56799)
0812 09:52:15.885331 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.885390 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.886476 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.887133 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.887143 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.887535 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:52:15.888238 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.888259 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.889427 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.889431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.890899 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.890913 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.891626 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.891631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.891872 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.892720 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:52:15.892743 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:52:15.894646 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:52:15.897077 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.897086 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.897109 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.897539 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.897948 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:52:15.897951 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:52:15.897953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:52:15.898177 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:52:15.898723 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:52:15.898730 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:52:15.899154 (+ 424us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.899385 (+ 231us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.899770 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":162,"threads_started":1}
I20260812 09:52:15.902539 24937 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41765
I20260812 09:52:15.902889 24937 heartbeater.cc:464] Registering TS with master...
I20260812 09:52:15.903644 24937 heartbeater.cc:511] Master 127.11.118.190:41765 requested a full tablet report, sending...
I20260812 09:52:15.905175 24375 ts_manager.cc:194] Registered new tserver with Master: e673d35f9214430bb51e1f5d6f629b7f (127.11.118.131:43015)
I20260812 09:52:15.905985 24375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:56799
I20260812 09:52:15.908946 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:52:15.926192 24624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.913499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47506 (local address 127.11.118.190:41765)
0812 09:52:15.913649 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.913654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.915391 (+ 1737us) server_negotiation.cc:407] Connection header received
0812 09:52:15.915548 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.915551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.915608 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.915707 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:52:15.917555 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.918382 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.919715 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.920037 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.920149 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.922063 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:52:15.922067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:52:15.922069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:52:15.922103 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:52:15.924060 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.924660 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.924664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.924666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.924765 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:52:15.925125 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:52:15.925129 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:52:15.925131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:52:15.925443 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:52:15.925597 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.925884 (+ 287us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.926020 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:52:15.930215 24375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47506:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:52:15.935137 24375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:52:15.955436 24950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.948649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:43741 (local address 127.0.0.1:47924)
0812 09:52:15.949337 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.949406 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.949542 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.950466 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.950472 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.950495 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:15.950624 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.950630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.952066 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.952069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.953472 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.953483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.954817 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.954821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.954952 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.955019 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.955130 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.955253 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":211,"threads_started":1}
I20260812 09:52:15.956349 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.948809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47924 (local address 127.11.118.129:43741)
0812 09:52:15.949816 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.949823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.949846 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:52:15.949920 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.949926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.950130 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.950280 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:15.950749 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.951907 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.953619 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.954466 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.954589 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.954750 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.956090 (+ 1340us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.956208 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":904,"thread_start_us":100,"threads_started":1}
I20260812 09:52:15.959831 24540 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e (DEFAULT_TABLE table=test-table [id=7a4d244c18604e33bb9bd41444b6d5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:52:15.960937 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.951669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33577 (local address 127.0.0.1:35186)
0812 09:52:15.954137 (+ 2468us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.954153 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.954244 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.955068 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.955072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.955092 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:15.955201 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.955206 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.956654 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.956658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.958896 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.958910 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.960419 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.960423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.960541 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.960569 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.960669 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.960762 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2404,"thread_start_us":94,"threads_started":1}
I20260812 09:52:15.961284 24540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac1f322c4c74582b05b6c850d5b2a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:52:15.961563 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.952114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.11.118.130:33577)
0812 09:52:15.953843 (+ 1729us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.953851 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.954344 (+ 493us) server_negotiation.cc:407] Connection header received
0812 09:52:15.954435 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.954442 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.954689 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.954892 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:15.955336 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.956504 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.959131 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.960035 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.960183 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.960333 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.961289 (+ 956us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.961413 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1601,"thread_start_us":100,"threads_started":1}
I20260812 09:52:15.966528 24693 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e (DEFAULT_TABLE table=test-table [id=7a4d244c18604e33bb9bd41444b6d5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:52:15.968004 24693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac1f322c4c74582b05b6c850d5b2a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:52:15.969214 24954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.950906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:43015 (local address 127.0.0.1:43104)
0812 09:52:15.952702 (+ 1796us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:15.952718 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:15.953924 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:15.964110 (+ 10186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:15.964113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:15.964138 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:15.964246 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.964254 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.965307 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.965310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.966561 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:15.966578 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.968704 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.968708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:15.968833 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.968867 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 09:52:15.968963 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 09:52:15.969060 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1731,"thread_start_us":149,"threads_started":1}
I20260812 09:52:15.969331 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:15.951098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43104 (local address 127.11.118.131:43015)
0812 09:52:15.963236 (+ 12138us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:15.963252 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:15.963280 (+ 28us) server_negotiation.cc:407] Connection header received
0812 09:52:15.963405 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:15.963411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:15.963639 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:15.963803 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:15.964385 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.965163 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.966725 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:15.967546 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:15.967677 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:15.967821 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:15.969003 (+ 1182us) server_negotiation.cc:299] Negotiation successful
0812 09:52:15.969166 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12003,"thread_start_us":110,"threads_started":1}
I20260812 09:52:15.972675 24842 tablet_service.cc:1467] Processing CreateTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e (DEFAULT_TABLE table=test-table [id=7a4d244c18604e33bb9bd41444b6d5f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:52:15.974032 24842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ac1f322c4c74582b05b6c850d5b2a7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:52:15.977862 24956 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Bootstrap starting.
I20260812 09:52:15.980505 24956 tablet_bootstrap.cc:654] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Neither blocks nor log segments found. Creating new log.
I20260812 09:52:15.981410 24956 log.cc:824] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:52:15.983711 24956 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: No bootstrap required, opened a new log
I20260812 09:52:15.983916 24956 ts_tablet_manager.cc:1397] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.004s
I20260812 09:52:15.987514 24959 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Bootstrap starting.
I20260812 09:52:15.989352 24956 raft_consensus.cc:348] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:15.989679 24956 raft_consensus.cc:374] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:52:15.989729 24956 raft_consensus.cc:729] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e204224d1a9d4bf491075167af5b72c9, State: Initialized, Role: FOLLOWER
I20260812 09:52:15.990221 24956 consensus_queue.cc:260] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:15.990728 24959 tablet_bootstrap.cc:654] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Neither blocks nor log segments found. Creating new log.
I20260812 09:52:15.991400 24956 ts_tablet_manager.cc:1428] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 09:52:15.991387 24957 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Bootstrap starting.
I20260812 09:52:15.991732 24959 log.cc:824] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:52:15.991809 24783 heartbeater.cc:503] Master 127.11.118.190:41765 was elected leader, sending a full tablet report...
I20260812 09:52:15.994027 24957 tablet_bootstrap.cc:654] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Neither blocks nor log segments found. Creating new log.
I20260812 09:52:15.995010 24957 log.cc:824] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Log is configured to *not* fsync() on all Append() calls
I20260812 09:52:15.997458 24957 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: No bootstrap required, opened a new log
I20260812 09:52:15.997694 24957 ts_tablet_manager.cc:1397] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 09:52:16.000720 24959 tablet_bootstrap.cc:492] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: No bootstrap required, opened a new log
I20260812 09:52:16.000962 24959 ts_tablet_manager.cc:1397] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260812 09:52:16.002544 24957 raft_consensus.cc:348] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.002871 24957 raft_consensus.cc:374] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:52:16.002930 24957 raft_consensus.cc:729] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de0de3cfc7e41f1b6cc2b7ac3a9fa08, State: Initialized, Role: FOLLOWER
I20260812 09:52:16.003525 24957 consensus_queue.cc:260] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.004663 24957 ts_tablet_manager.cc:1428] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:52:16.005056 24621 heartbeater.cc:503] Master 127.11.118.190:41765 was elected leader, sending a full tablet report...
I20260812 09:52:16.005017 24959 raft_consensus.cc:348] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.005297 24959 raft_consensus.cc:374] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:52:16.005359 24959 raft_consensus.cc:729] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e673d35f9214430bb51e1f5d6f629b7f, State: Initialized, Role: FOLLOWER
I20260812 09:52:16.005872 24959 consensus_queue.cc:260] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.007035 24959 ts_tablet_manager.cc:1428] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260812 09:52:16.007390 24937 heartbeater.cc:503] Master 127.11.118.190:41765 was elected leader, sending a full tablet report...
W20260812 09:52:16.011790 24623 tablet.cc:2369] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:52:16.076918 24964 raft_consensus.cc:482] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:52:16.077157 24964 raft_consensus.cc:504] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.078590 24964 leader_election.cc:288] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e673d35f9214430bb51e1f5d6f629b7f (127.11.118.131:43015), e204224d1a9d4bf491075167af5b72c9 (127.11.118.130:33577)
I20260812 09:52:16.083278 24967 raft_consensus.cc:482] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:52:16.083518 24967 raft_consensus.cc:504] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.084975 24967 leader_election.cc:288] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 (127.11.118.129:43741), e204224d1a9d4bf491075167af5b72c9 (127.11.118.130:33577)
Aug 12 09:52:16 dist-test-slave-2w3w krb5kdc[23838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528335, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:52:16.091424 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.086728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:56717 (local address 127.11.118.129:43741)
0812 09:52:16.086952 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:16.086982 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:16.086999 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:52:16.087050 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:16.087056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:16.087107 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:16.087217 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:16.087548 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.088326 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.089951 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.090581 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.090683 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.090737 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:16.091182 (+ 445us) server_negotiation.cc:299] Negotiation successful
0812 09:52:16.091274 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260812 09:52:16.091949 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.085347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:43741 (local address 127.11.118.131:56717)
0812 09:52:16.086082 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.086098 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:16.086205 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:16.087232 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:16.087235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:16.087254 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:16.087400 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.087409 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.088488 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.088491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.089774 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.089786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.090869 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.090872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.091017 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.091045 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 09:52:16.091684 (+ 639us) client_negotiation.cc:240] Negotiation successful
0812 09:52:16.091777 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640}
I20260812 09:52:16.092612 24560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "e673d35f9214430bb51e1f5d6f629b7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" is_pre_election: true
I20260812 09:52:16.092905 24560 raft_consensus.cc:2454] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e673d35f9214430bb51e1f5d6f629b7f in term 0.
I20260812 09:52:16.093462 24807 leader_election.cc:302] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de0de3cfc7e41f1b6cc2b7ac3a9fa08, e673d35f9214430bb51e1f5d6f629b7f; no voters:
I20260812 09:52:16.093820 24967 raft_consensus.cc:2781] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:52:16.093915 24967 raft_consensus.cc:482] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:52:16.093957 24967 raft_consensus.cc:3037] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:52:16.095234 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.080524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:55803 (local address 127.11.118.131:43015)
0812 09:52:16.080645 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:16.080650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:16.084536 (+ 3886us) server_negotiation.cc:407] Connection header received
0812 09:52:16.086646 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:16.086650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:16.086709 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:16.086783 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:16.091212 (+ 4429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.091949 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.093844 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.094441 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.094540 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.094589 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:16.095008 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 09:52:16.095098 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:52:16.095458 24967 raft_consensus.cc:504] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.095650 24969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.080030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:43015 (local address 127.11.118.129:55803)
0812 09:52:16.084428 (+ 4398us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.084446 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:16.084615 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:16.086917 (+ 2302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:16.086920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:16.086943 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:16.089531 (+ 2588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.089544 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.092441 (+ 2897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.092444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.093675 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.093687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.094696 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.094699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.094821 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.094847 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 09:52:16.095385 (+ 538us) client_negotiation.cc:240] Negotiation successful
0812 09:52:16.095474 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4307,"thread_start_us":311,"threads_started":1}
I20260812 09:52:16.095852 24967 leader_election.cc:288] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [CANDIDATE]: Term 1 election: Requested vote from peers 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 (127.11.118.129:43741), e204224d1a9d4bf491075167af5b72c9 (127.11.118.130:33577)
I20260812 09:52:16.096505 24560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "e673d35f9214430bb51e1f5d6f629b7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08"
I20260812 09:52:16.096591 24874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e673d35f9214430bb51e1f5d6f629b7f" is_pre_election: true
I20260812 09:52:16.096637 24560 raft_consensus.cc:3037] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:52:16.096801 24874 raft_consensus.cc:2379] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 in current term 1: Already voted for candidate e673d35f9214430bb51e1f5d6f629b7f in this term.
I20260812 09:52:16.098029 24560 raft_consensus.cc:2454] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e673d35f9214430bb51e1f5d6f629b7f in term 1.
I20260812 09:52:16.098449 24807 leader_election.cc:302] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de0de3cfc7e41f1b6cc2b7ac3a9fa08, e673d35f9214430bb51e1f5d6f629b7f; no voters:
I20260812 09:52:16.098670 24967 raft_consensus.cc:2781] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:52:16.098951 24967 raft_consensus.cc:686] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 LEADER]: Becoming Leader. State: Replica: e673d35f9214430bb51e1f5d6f629b7f, State: Running, Role: LEADER
I20260812 09:52:16.099390 24967 consensus_queue.cc:237] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } }
I20260812 09:52:16.103595 24372 catalog_manager.cc:5495] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e673d35f9214430bb51e1f5d6f629b7f (127.11.118.131). New cstate: current_term: 1 leader_uuid: "e673d35f9214430bb51e1f5d6f629b7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e673d35f9214430bb51e1f5d6f629b7f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 43015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 } health_report { overall_health: UNKNOWN } } }
I20260812 09:52:16.107970 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.079025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33577 (local address 127.11.118.129:36841)
0812 09:52:16.081267 (+ 2242us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.081282 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:16.081476 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:16.081849 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:16.081851 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:16.081879 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:16.081982 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.081987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.083008 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.083012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.104073 (+ 21061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.104094 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.107372 (+ 3278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.107377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.107494 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.107539 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 09:52:16.107630 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 09:52:16.107766 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2168,"thread_start_us":149,"threads_started":1}
I20260812 09:52:16.108273 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.079649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:36841 (local address 127.11.118.130:33577)
0812 09:52:16.079781 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:16.079785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:16.081377 (+ 1592us) server_negotiation.cc:407] Connection header received
0812 09:52:16.081607 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:16.081611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:16.081661 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:16.081707 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:16.082101 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.082821 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.104866 (+ 22045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.105480 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.105599 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.105650 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:16.108023 (+ 2373us) server_negotiation.cc:299] Negotiation successful
0812 09:52:16.108140 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:52:16.108925 24727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e204224d1a9d4bf491075167af5b72c9" is_pre_election: true
I20260812 09:52:16.109290 24727 raft_consensus.cc:2454] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 in term 0.
I20260812 09:52:16.110392 24489 leader_election.cc:302] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7de0de3cfc7e41f1b6cc2b7ac3a9fa08, e204224d1a9d4bf491075167af5b72c9; no voters: e673d35f9214430bb51e1f5d6f629b7f
I20260812 09:52:16.111047 24964 raft_consensus.cc:2741] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 09:52:16.118791 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.085684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33577 (local address 127.11.118.131:37541)
0812 09:52:16.086136 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.086155 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:52:16.086241 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:52:16.106108 (+ 19867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:52:16.106112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:52:16.106141 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:52:16.106347 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.106377 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.116101 (+ 9724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.116106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.117257 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:52:16.117276 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.118309 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.118316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:52:16.118442 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.118474 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 09:52:16.118532 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 09:52:16.118622 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":156,"threads_started":1}
I20260812 09:52:16.119608 24973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.087407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:37541 (local address 127.11.118.130:33577)
0812 09:52:16.104943 (+ 17536us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:16.104953 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:16.104965 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:52:16.105020 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:16.105023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:16.105074 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:16.105167 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:52:16.115094 (+ 9927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.115935 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.117475 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.118130 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.119259 (+ 1129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.119319 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:16.119375 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 09:52:16.119453 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17448,"thread_start_us":122,"threads_started":1}
I20260812 09:52:16.120265 24726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "e673d35f9214430bb51e1f5d6f629b7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e204224d1a9d4bf491075167af5b72c9"
I20260812 09:52:16.120447 24726 raft_consensus.cc:3037] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:52:16.121940 24726 raft_consensus.cc:2454] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e673d35f9214430bb51e1f5d6f629b7f in term 1.
I20260812 09:52:16.122238 24727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ac1f322c4c74582b05b6c850d5b2a7e" candidate_uuid: "e673d35f9214430bb51e1f5d6f629b7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e204224d1a9d4bf491075167af5b72c9" is_pre_election: true
I20260812 09:52:16.122392 24727 raft_consensus.cc:2362] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e673d35f9214430bb51e1f5d6f629b7f in term 1. Re-sending same reply.
W20260812 09:52:16.136494 24938 tablet.cc:2369] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:52:16.161212 24953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.154182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43106 (local address 127.11.118.131:43015)
0812 09:52:16.154317 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 09:52:16.154323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:52:16.154340 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:52:16.154434 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:52:16.154437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:52:16.154510 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:52:16.154617 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:52:16.155079 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.155726 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.156813 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:52:16.157118 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:52:16.157242 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:52:16.157677 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:52:16.158291 (+ 614us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:52:16.158413 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:52:16.160925 (+ 2512us) server_negotiation.cc:299] Negotiation successful
0812 09:52:16.161011 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 09:52:16.161504 24784 tablet.cc:2369] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:52:16.178488 24727 raft_consensus.cc:1261] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 1 FOLLOWER]: Refusing update from remote peer e673d35f9214430bb51e1f5d6f629b7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:52:16.178488 24560 raft_consensus.cc:1261] T 3ac1f322c4c74582b05b6c850d5b2a7e P 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 [term 1 FOLLOWER]: Refusing update from remote peer e673d35f9214430bb51e1f5d6f629b7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:52:16.179255 24967 consensus_queue.cc:1035] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de0de3cfc7e41f1b6cc2b7ac3a9fa08" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 43741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:52:16.179858 24974 consensus_queue.cc:1035] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e204224d1a9d4bf491075167af5b72c9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 33577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:52:16.204726 24978 mvcc.cc:205] Tried to move back new op lower bound from 7317620064977788928 to 7317620064666472448. Current Snapshot: MvccSnapshot[applied={T|T < 7317620064977788928}]
I20260812 09:52:16.209071 24980 mvcc.cc:205] Tried to move back new op lower bound from 7317620064977788928 to 7317620064666472448. Current Snapshot: MvccSnapshot[applied={T|T < 7317620064977788928}]
I20260812 09:52:16.219059 24375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:52:16.219259 24375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:52:16.222204 24375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63b097316b1b4656b7333128399e4107: Sending DeleteTablet for 3 replicas of tablet 3ac1f322c4c74582b05b6c850d5b2a7e
I20260812 09:52:16.223148 24842 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:52:16 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:43104
I20260812 09:52:16.223237 24540 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:52:16 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:47924
I20260812 09:52:16.224151 24693 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ac1f322c4c74582b05b6c850d5b2a7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:52:16 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:35186
I20260812 09:52:16.224701 24989 tablet_replica.cc:330] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9: stopping tablet replica
I20260812 09:52:16.225085 24989 raft_consensus.cc:2229] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:52:16.225386 24989 raft_consensus.cc:2258] T 3ac1f322c4c74582b05b6c850d5b2a7e P e204224d1a9d4bf491075167af5b72c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:52:16.225705 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 24468
I20260812 09:52:16.229782 24987 tablet_replica.cc:330] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: stopping tablet replica
I20260812 09:52:16.230908 24987 raft_consensus.cc:2229] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:52:16.232419 24987 raft_consensus.cc:2258] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:52:16.237489 24987 ts_tablet_manager.cc:1905] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:52:16.241518 24987 ts_tablet_manager.cc:1918] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:52:16.241732 24987 log.cc:1196] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/3ac1f322c4c74582b05b6c850d5b2a7e
I20260812 09:52:16.242161 24987 ts_tablet_manager.cc:1939] T 3ac1f322c4c74582b05b6c850d5b2a7e P e673d35f9214430bb51e1f5d6f629b7f: Deleting consensus metadata
I20260812 09:52:16.243813 24358 catalog_manager.cc:4841] TS e673d35f9214430bb51e1f5d6f629b7f (127.11.118.131:43015): tablet 3ac1f322c4c74582b05b6c850d5b2a7e (table test-table [id=7a4d244c18604e33bb9bd41444b6d5f2]) successfully deleted
W20260812 09:52:16.255203 24359 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:43741 (error 108)
I20260812 09:52:16.256927 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 24630
I20260812 09:52:16.257767 24954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.256629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:43741 (local address 127.0.0.1:47926)
0812 09:52:16.257595 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.257675 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:43741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":874}
W20260812 09:52:16.263470 24359 catalog_manager.cc:4584] TS 7de0de3cfc7e41f1b6cc2b7ac3a9fa08 (127.11.118.129:43741): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3ac1f322c4c74582b05b6c850d5b2a7e: Network error: Client connection negotiation failed: client connection to 127.11.118.129:43741: connect: Connection refused (error 111)
I20260812 09:52:16.268813 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 24789
I20260812 09:52:16.273005 24954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:52:16.272589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:33577 (local address 127.0.0.1:35192)
0812 09:52:16.272832 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 09:52:16.272901 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.130:33577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260812 09:52:16.279887 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 24341
I20260812 09:52:16.289844 11738 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 09:52:16.636543 11738 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 09:52:16.636816 11738 mini_ranger.cc:66] Stopping Ranger...
I20260812 09:52:16.993463 11738 mini_ranger.cc:68] Stopped Ranger
2026-08-12 09:52:16.993 UTC [23873] LOG: received smart shutdown request
2026-08-12 09:52:16.999 UTC [23873] LOG: background worker "logical replication launcher" (PID 23882) exited with exit code 1
2026-08-12 09:52:16.999 UTC [23877] LOG: shutting down
2026-08-12 09:52:17.194 UTC [23873] LOG: database system is shut down
2026-08-12T09:52:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53872 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:52:17 dist-test-slave-2w3w krb5kdc[25002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:52:17 dist-test-slave-2w3w krb5kdc[25002](info): set up 2 sockets
Aug 12 09:52:17 dist-test-slave-2w3w krb5kdc[25002](info): commencing operation
krb5kdc: starting...
W20260812 09:52:18.488686 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:52:18 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:52:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:52:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangeradmin_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangeradmin_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangerlookup_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangerlookup_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
I20260812 09:52:18.692278 11738 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskilB4wR/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/postgres -l logfile start
2026-08-12 09:52:21.729 UTC [25037] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 09:52:21.729 UTC [25037] LOG: listening on IPv4 address "127.11.118.148", port 59047
2026-08-12 09:52:21.734 UTC [25037] LOG: listening on Unix socket "/tmp/.s.PGSQL.59047"
2026-08-12 09:52:21.759 UTC [25042] LOG: database system was shut down at 2026-08-12 09:52:19 UTC
2026-08-12 09:52:21.763 UTC [25037] LOG: database system is ready to accept connections
I20260812 09:52:22.798156 11738 mini_postgres.cc:96] Postgres bound to 59047
2026-08-12 09:52:22.806 UTC [25050] FATAL: database "slave" does not exist
127.11.118.148:59047 - accepting connections
I20260812 09:52:22.807163 11738 mini_ranger.cc:161] Starting Ranger...
I20260812 09:52:22.825347 11738 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 09:52:23.477162 11738 mini_ranger.cc:87] Created ranger Postgres database
I20260812 09:52:23.477283 11738 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin
2026-08-12 09:52:23,778 [I] DB FLAVOR :POSTGRES
2026-08-12 09:52:23,779 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 09:52:23,779 [I] Checking connection..
2026-08-12 09:52:23,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 09:52:24,071 [I] Checking connection passed.
2026-08-12 09:52:24,071 [I] --------- Verifying version history table ---------
2026-08-12 09:52:24,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:52:24,365 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 09:52:24,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:52:24,625 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 09:52:24,625 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 09:52:24,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 09:52:24.906 UTC [25121] WARNING: there is no transaction in progress
2026-08-12 09:52:24,915 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 09:52:24,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 09:52:25,195 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 09:52:25,195 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 09:52:25,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 09:52:25,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 09:52:25,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2w3w.c.gcp-upstream.internal','N') ;"
2026-08-12 09:52:25,979 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 09:52:26,269 [I] Table x_portal_user does not exist in database ranger
2026-08-12 09:52:26,270 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 09:52:26,552 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 09:52:26,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 09:52:26,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 09:52:27,098 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 09:52:27,098 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 09:52:28.256 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.276 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.299 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.320 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.343 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.369 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.444 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.452 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.469 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.482 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.494 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.512 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.524 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.532 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.541 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:28.551 UTC [25248] WARNING: there is no transaction in progress
2026-08-12 09:52:29,376 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 09:52:29,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 09:52:29,634 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 09:52:29,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 09:52:29,918 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 09:52:29,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 09:52:30,190 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 09:52:30,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 09:52:30,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 09:52:30,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2w3w.c.gcp-upstream.internal';"
2026-08-12 09:52:30,953 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 09:52:30,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 09:52:31,224 [I] DB_PATCHES have already been applied
I20260812 09:52:31.230870 11738 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskilB4wR/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 09:52:31.230943 11738 mini_ranger.cc:193] Using host: 127.11.118.148
I20260812 09:52:31.235536 11738 mini_ranger.cc:227] Ranger admin URL: http://127.11.118.148:37107
Aug 12, 2026 9:52:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:52:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:52:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 9:52:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 9:52:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 9:52:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 9:52:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 09:52:32.435873 11738 mini_ranger.cc:160] Time spent starting Ranger: real 9.629s user 0.000s sys 0.013s
Aug 12, 2026 9:52:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 9:52:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 12, 2026 9:52:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 9:52:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 9:52:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 09:52:57.150240 11738 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.118.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.118.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangerkms_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.118.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/rangerkms_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.118.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.118.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.118.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/HTTP_127.11.118.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 09:52:57 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528377, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 09:52:57.262212 11738 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 09:52:57.274585 11738 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 09:52:58.698845 11738 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 09:52:58.698945 11738 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms
I20260812 09:52:58.698997 11738 mini_ranger_kms.cc:227] Using postgres at 127.11.118.148:59047
2026-08-12 09:52:58,916 [I] DB FLAVOR :POSTGRES
2026-08-12 09:52:58,917 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 09:52:58,917 [I] Checking connection
2026-08-12 09:52:58,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 09:52:59,255 [I] connection success
2026-08-12 09:52:59,255 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 09:52:59,255 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 09:52:59,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 09:52:59,560 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 09:52:59,560 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 09:52:59,560 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 09:52:59,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.118.148:59047/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 09:52:59,894 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 09:53:00.476512 11738 mini_ranger_kms.cc:310] Created kms service
I20260812 09:53:00.703549 11738 mini_ranger_kms.cc:326] Created kudu user
I20260812 09:53:00.756024 11738 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 09:53:00 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528377, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:01.287102 11738 mini_ranger_kms.cc:384] Added ranger policy
I20260812 09:53:01.287274 11738 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms:/tmp/dist-test-taskilB4wR/build/debug/bin/postgresql.jar:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskilB4wR/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 09:53:01.287297 11738 mini_ranger_kms.cc:240] Using host: 127.11.118.148
I20260812 09:53:01.293022 11738 mini_ranger_kms.cc:276] Ranger KMS PID: 25459
I20260812 09:53:01.293154 11738 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.118.148:47413
Aug 12, 2026 9:53:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 9:53:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 9:53:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 9:53:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 9:53:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 9:53:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260812 09:53:03.854009 11738 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.592s user 0.000s sys 0.198s
I20260812 09:53:03.854178 11738 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 09:53:03.854301 11738 mini_ranger_kms.cc:401] 127.11.118.148:47413/kms/v1/keys
Aug 12 09:53:04 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786528384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 09:53:04 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
Aug 12 09:53:04 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528384, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.118.148@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
Aug 12 09:53:07 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:53:07.375787 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41675
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:41675
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:07.500665 25520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:07.500993 25520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:07.501035 25520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:07.505681 25520 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:07.505769 25520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:07.505788 25520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:07.505811 25520 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:07.505827 25520 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:07.512205 25520 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.118.148:47413/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:41675
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:07.513521 25520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:07.514700 25520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:07.524766 25529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:07.524981 25531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:07.524765 25528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:07.524808 25520 server_base.cc:1034] running on GCE node
I20260812 09:53:07.525780 25520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:07.527128 25520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:07.528368 25520 hybrid_clock.cc:648] HybridClock initialized: now 1786528387528351 us; error 45 us; skew 500 ppm
Aug 12 09:53:07 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:07.536814 25520 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:07.538044 25520 webserver.cc:460] Webserver started at http://127.11.118.190:43311/ using document root <none> and password file <none>
I20260812 09:53:07.538720 25520 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:07.538822 25520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:07.539162 25520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:53:07 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:07.600363 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "80a034482e004a36862aa3ca4d4c53a0"
format_stamp: "Formatted at 2026-08-12 09:53:07 on dist-test-slave-2w3w"
server_key: "4766dffd5497a397c24ca9df7f3b65c1"
server_key_iv: "b7ec78bfaa9ad63f204e0973c852b26d"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:07.601081 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "80a034482e004a36862aa3ca4d4c53a0"
format_stamp: "Formatted at 2026-08-12 09:53:07 on dist-test-slave-2w3w"
server_key: "4766dffd5497a397c24ca9df7f3b65c1"
server_key_iv: "b7ec78bfaa9ad63f204e0973c852b26d"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:07.605810 25520 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:53:07.625691 25540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:07.627849 25520 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:53:07.628021 25520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "80a034482e004a36862aa3ca4d4c53a0"
format_stamp: "Formatted at 2026-08-12 09:53:07 on dist-test-slave-2w3w"
server_key: "4766dffd5497a397c24ca9df7f3b65c1"
server_key_iv: "b7ec78bfaa9ad63f204e0973c852b26d"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:07.628177 25520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:07.652036 25520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:07.655507 25520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:07.655692 25520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:07.663766 25520 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:41675
I20260812 09:53:07.663780 25602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:41675 every 8 connection(s)
I20260812 09:53:07.664824 25520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:07.666705 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 25520
I20260812 09:53:07.666908 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:53:07.667313 11738 external_mini_cluster.cc:1428] Setting key 6d4cf5d77ebd89bde86683f555114feb
I20260812 09:53:07.668406 25603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:07.676782 25603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Bootstrap starting.
Aug 12 09:53:07 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:07.679913 25603 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:07.681424 25603 log.cc:824] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:07.684299 25603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: No bootstrap required, opened a new log
I20260812 09:53:07.685412 25606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:07.668926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41716 (local address 127.11.118.190:41675)
0812 09:53:07.669377 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:07.669399 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:07.669447 (+ 48us) server_negotiation.cc:407] Connection header received
0812 09:53:07.670475 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:07.670502 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:07.671017 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:07.671441 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:07.672225 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:07.673874 (+ 1649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:07.674868 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:07.675928 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:07.676113 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:07.679374 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:07.679382 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:07.679402 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:07.679444 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:07.681717 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:07.682391 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:07.682396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:07.682402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:07.682600 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:07.683047 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:07.683051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:07.683053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:07.683603 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:07.683826 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:07.684128 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 09:53:07.684433 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":115,"threads_started":1}
I20260812 09:53:07.688153 25603 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:07.688459 25603 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:07.688499 25603 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a034482e004a36862aa3ca4d4c53a0, State: Initialized, Role: FOLLOWER
I20260812 09:53:07.688911 25603 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:07.689036 25603 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:07.689083 25603 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:07.689157 25603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:07.690111 25603 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:07.690421 25603 leader_election.cc:302] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80a034482e004a36862aa3ca4d4c53a0; no voters:
I20260812 09:53:07.690712 25603 leader_election.cc:288] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:53:07.690867 25608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:07.691180 25608 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 LEADER]: Becoming Leader. State: Replica: 80a034482e004a36862aa3ca4d4c53a0, State: Running, Role: LEADER
I20260812 09:53:07.691500 25608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:07.692117 25603 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:07.693410 25609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80a034482e004a36862aa3ca4d4c53a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } } }
I20260812 09:53:07.693554 25609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:07.694124 25611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a034482e004a36862aa3ca4d4c53a0. Latest consensus state: current_term: 1 leader_uuid: "80a034482e004a36862aa3ca4d4c53a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } } }
I20260812 09:53:07.694224 25611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:07.694571 25603 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 09:53:07.695010 25619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:07.701442 25619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:07.709447 25619 catalog_manager.cc:1347] Generated new cluster ID: d8a1d81f3be5419f8c0c767449968dc0
I20260812 09:53:07.709659 25619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:07.727352 25619 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:53:07.728888 25619 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:07.742127 25619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Generated new TSK 0
I20260812 09:53:07.743232 25619 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:53:08.479926 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:08.643533 25654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:08.643887 25654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:08.644016 25654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:08.648902 25654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:08.649080 25654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:08.649228 25654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:08.656563 25654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:08.657840 25654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:08.659015 25654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:08.671984 25663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:08.671983 25665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:08.672729 25662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:08.673543 25654 server_base.cc:1034] running on GCE node
I20260812 09:53:08.674157 25654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:08.675320 25654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:08.676571 25654 hybrid_clock.cc:648] HybridClock initialized: now 1786528388676505 us; error 83 us; skew 500 ppm
Aug 12 09:53:08 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:08.680313 25654 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:08.681351 25654 webserver.cc:460] Webserver started at http://127.11.118.129:45915/ using document root <none> and password file <none>
I20260812 09:53:08.681988 25654 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:08.682093 25654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:08.682348 25654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:53:08 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:08.701421 25654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "1a68a579405046b987e36ecf01601272"
format_stamp: "Formatted at 2026-08-12 09:53:08 on dist-test-slave-2w3w"
server_key: "0bf06aeeb56ef76cdbc9280af7d46fa1"
server_key_iv: "acac36f7a6d04dea6d596b4a362ef0c8"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:08.703123 25654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "1a68a579405046b987e36ecf01601272"
format_stamp: "Formatted at 2026-08-12 09:53:08 on dist-test-slave-2w3w"
server_key: "0bf06aeeb56ef76cdbc9280af7d46fa1"
server_key_iv: "acac36f7a6d04dea6d596b4a362ef0c8"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:08.709918 25654 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260812 09:53:08.733613 25674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:08.735690 25654 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260812 09:53:08.735882 25654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "1a68a579405046b987e36ecf01601272"
format_stamp: "Formatted at 2026-08-12 09:53:08 on dist-test-slave-2w3w"
server_key: "0bf06aeeb56ef76cdbc9280af7d46fa1"
server_key_iv: "acac36f7a6d04dea6d596b4a362ef0c8"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:08.736058 25654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:08.790400 25654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:08.795459 25654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:08.795759 25654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:08.796509 25654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:08.797693 25654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:08.797762 25654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:08.797818 25654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:08.797894 25654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260812 09:53:08.811004 25654 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:42131
I20260812 09:53:08.811200 25810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:42131 every 8 connection(s)
I20260812 09:53:08.812583 25654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:08.822784 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 25654
I20260812 09:53:08.822955 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:53:08.823371 11738 external_mini_cluster.cc:1428] Setting key 21da40c49f44dd46f1e30220ddfe458b
Aug 12 09:53:08 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:08.832252 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:08.815105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:38145 (local address 127.11.118.190:41675)
0812 09:53:08.815426 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:08.815431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:08.816590 (+ 1159us) server_negotiation.cc:407] Connection header received
0812 09:53:08.817982 (+ 1392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:08.817987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:08.818054 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:08.818181 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:08.819862 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:08.820745 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:08.822687 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:08.823105 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:08.823199 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:08.826918 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:08.826922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:08.826925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:08.826953 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:08.828999 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:08.830141 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:08.830145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:08.830147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:08.830249 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:08.830709 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:08.830713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:08.830715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:08.831012 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:08.831096 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:08.831880 (+ 784us) server_negotiation.cc:299] Negotiation successful
0812 09:53:08.832056 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":78,"threads_started":1}
I20260812 09:53:08.834421 25814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:08.815699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.129:38145)
0812 09:53:08.816385 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:08.816455 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:08.817686 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:08.818410 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:08.818420 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:08.818820 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:08.819638 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:08.819661 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:08.820935 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:08.820939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:08.822512 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:08.822526 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:08.823447 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:08.823451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:08.823690 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:08.824661 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:08.824683 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:08.826677 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:08.829533 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:08.829541 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:08.829561 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:08.830006 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:08.830371 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:08.830374 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:08.830376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:08.830586 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:08.831191 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:08.831198 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:08.831568 (+ 370us) client_negotiation.cc:769] Sending connection context
0812 09:53:08.832774 (+ 1206us) client_negotiation.cc:240] Negotiation successful
0812 09:53:08.833190 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":197,"threads_started":1}
I20260812 09:53:08.836428 25811 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:08.836714 25811 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:08.837440 25811 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:08.839582 25559 ts_manager.cc:194] Registered new tserver with Master: 1a68a579405046b987e36ecf01601272 (127.11.118.129:42131)
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:53:08.841279 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:38145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
Aug 12 09:53:08 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786528388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:53:08.867758 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:09.020490 25819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:09.020869 25819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:09.020973 25819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:09.027012 25819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:09.027122 25819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:09.027237 25819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:09.035558 25819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:09.037022 25819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:09.038312 25819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:09.056768 25830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.063648 25828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.063951 25826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:09.069814 25819 server_base.cc:1034] running on GCE node
I20260812 09:53:09.070480 25819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:09.071431 25819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:09.079088 25819 hybrid_clock.cc:648] HybridClock initialized: now 1786528389078974 us; error 132 us; skew 500 ppm
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:09.083199 25819 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:09.084466 25819 webserver.cc:460] Webserver started at http://127.11.118.130:39529/ using document root <none> and password file <none>
I20260812 09:53:09.085155 25819 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:09.085274 25819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:09.085575 25819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:09.111924 25819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "fa46616609f4448d853c14f2671dbb79"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "6de31501bcea5df259902f492d739afa"
server_key_iv: "69ed51ab5a1367855508481d7bc5348e"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.112839 25819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "fa46616609f4448d853c14f2671dbb79"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "6de31501bcea5df259902f492d739afa"
server_key_iv: "69ed51ab5a1367855508481d7bc5348e"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.119024 25819 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260812 09:53:09.139887 25837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.141883 25819 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.000s
I20260812 09:53:09.142151 25819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "fa46616609f4448d853c14f2671dbb79"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "6de31501bcea5df259902f492d739afa"
server_key_iv: "69ed51ab5a1367855508481d7bc5348e"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.142350 25819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:09.176869 25819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:09.183579 25819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:09.183821 25819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:09.184870 25819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:09.186314 25819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:09.186473 25819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.186703 25819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:09.186805 25819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.199393 25819 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45249
I20260812 09:53:09.199795 25970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45249 every 8 connection(s)
I20260812 09:53:09.200685 25819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:09.207758 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 25819
I20260812 09:53:09.207914 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:53:09.208236 11738 external_mini_cluster.cc:1428] Setting key 47c93f2b96c077d873ba05630759b0d0
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:09.220623 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:09.203182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:38793 (local address 127.11.118.190:41675)
0812 09:53:09.203356 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:09.203362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:09.204698 (+ 1336us) server_negotiation.cc:407] Connection header received
0812 09:53:09.206192 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:09.206196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:09.206280 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:09.206400 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:09.208525 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.209315 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.211201 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.211567 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.211658 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:09.215491 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:09.215496 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:09.215499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:09.215538 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:09.217567 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:09.218460 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:09.218465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:09.218467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:09.218572 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:09.219092 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:09.219095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:09.219097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:09.219372 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:09.219467 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:09.220258 (+ 791us) server_negotiation.cc:299] Negotiation successful
0812 09:53:09.220418 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 09:53:09.222646 25973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:09.203779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.130:38793)
0812 09:53:09.204481 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:09.204555 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:09.205832 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:09.206771 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:09.206782 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:09.207273 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:09.208086 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:09.208287 (+ 201us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.209505 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.209509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:09.211034 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:09.211048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.211916 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.211920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:09.212179 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:09.213066 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:09.213093 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:09.215182 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:09.217769 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:09.217781 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:09.217816 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:09.218311 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:09.218698 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:09.218701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:09.218703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:09.218913 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:09.219544 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:09.219553 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:09.219923 (+ 370us) client_negotiation.cc:769] Sending connection context
0812 09:53:09.220842 (+ 919us) client_negotiation.cc:240] Negotiation successful
0812 09:53:09.221429 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":195,"threads_started":1}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:53:09.224870 25971 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:09.225183 25971 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:09.225880 25971 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:09.227355 25559 ts_manager.cc:194] Registered new tserver with Master: fa46616609f4448d853c14f2671dbb79 (127.11.118.130:45249)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:53:09.228291 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:38793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:53:09.270694 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:09.463913 25977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:09.464335 25977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:09.464417 25977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:09.470568 25977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:09.470675 25977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:09.470765 25977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:09.479403 25977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:09.481406 25977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:09.483984 25977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:09.499792 25985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.499785 25987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.499797 25984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:09.502197 25977 server_base.cc:1034] running on GCE node
I20260812 09:53:09.502839 25977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:09.503924 25977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:09.521260 25977 hybrid_clock.cc:648] HybridClock initialized: now 1786528389521142 us; error 128 us; skew 500 ppm
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:09.525535 25977 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:09.527099 25977 webserver.cc:460] Webserver started at http://127.11.118.131:37685/ using document root <none> and password file <none>
I20260812 09:53:09.528332 25977 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:09.528514 25977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:09.528846 25977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:09.557859 25977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "176cc6786b1d40cc9cdc2ab4d6993db2"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "871af9d5daf46d66474c00156d90eba5"
server_key_iv: "6b9dd127b4a234b8563b1980c7d47602"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.563025 25977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "176cc6786b1d40cc9cdc2ab4d6993db2"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "871af9d5daf46d66474c00156d90eba5"
server_key_iv: "6b9dd127b4a234b8563b1980c7d47602"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.581187 25977 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.000s sys 0.005s
I20260812 09:53:09.607568 25994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.609946 25977 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.000s
I20260812 09:53:09.610136 25977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "176cc6786b1d40cc9cdc2ab4d6993db2"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "871af9d5daf46d66474c00156d90eba5"
server_key_iv: "6b9dd127b4a234b8563b1980c7d47602"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:09.610303 25977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:09.670702 25977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:09.675482 25977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:09.675763 25977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:09.676460 25977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:09.677521 25977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:09.677670 25977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 09:53:09.677768 25977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:09.677803 25977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.690141 25977 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:45967
I20260812 09:53:09.690315 26126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:45967 every 8 connection(s)
I20260812 09:53:09.691419 25977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:09.695309 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 25977
I20260812 09:53:09.695470 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:53:09.695816 11738 external_mini_cluster.cc:1428] Setting key ad30d3fff0de474c6d662a3f47bac18f
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:09.712306 25813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:09.693727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:36729 (local address 127.11.118.190:41675)
0812 09:53:09.693879 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:09.693884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:09.695134 (+ 1250us) server_negotiation.cc:407] Connection header received
0812 09:53:09.696658 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:09.696662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:09.696730 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:09.696790 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:09.698680 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.699535 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.701337 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.701718 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.701850 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:09.705420 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:09.705426 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:09.705429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:09.705465 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:09.707406 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:09.709969 (+ 2563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:09.709974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:09.709976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:09.710104 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:09.710740 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:09.710744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:09.710746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:09.711048 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:09.711151 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:09.711981 (+ 830us) server_negotiation.cc:299] Negotiation successful
0812 09:53:09.712139 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:53:09.713653 26129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:09.694301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.131:36729)
0812 09:53:09.694911 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:09.695003 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:09.696317 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:09.697283 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:09.697293 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:09.697717 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:09.698483 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:09.698511 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.699698 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.699702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:09.701154 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:09.701170 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:09.702095 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:09.702099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:09.702340 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:09.703173 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:09.703197 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:09.705143 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:09.707600 (+ 2457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:09.707610 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:09.707634 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:09.708085 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:09.710247 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:09.710252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:09.710254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:09.710569 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:09.711181 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:09.711190 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:09.711635 (+ 445us) client_negotiation.cc:769] Sending connection context
0812 09:53:09.711895 (+ 260us) client_negotiation.cc:240] Negotiation successful
0812 09:53:09.712308 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":204,"threads_started":1}
I20260812 09:53:09.715521 26127 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:09.715848 26127 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:09.716544 26127 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:09.717988 25559 ts_manager.cc:194] Registered new tserver with Master: 176cc6786b1d40cc9cdc2ab4d6993db2 (127.11.118.131:45967)
I20260812 09:53:09.718796 25559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:36729
I20260812 09:53:09.724041 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:53:09.724783 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 25654
I20260812 09:53:09.744957 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 25819
I20260812 09:53:09.758002 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 25977
I20260812 09:53:09.768702 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 25520
I20260812 09:53:09.779312 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41675
--webserver_interface=127.11.118.190
--webserver_port=43311
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:41675
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:09.901721 26131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:09.902073 26131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:09.902118 26131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:09.906500 26131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:09.906641 26131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:09.906666 26131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:09.906683 26131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:09.906699 26131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:09.915683 26131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:41675
--ranger_config_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:41675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=43311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:09.917354 26131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:09.919091 26131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:09.932798 26137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.932777 26136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:09.932778 26139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:09.933398 26131 server_base.cc:1034] running on GCE node
I20260812 09:53:09.934393 26131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:09.935877 26131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:09.937295 26131 hybrid_clock.cc:648] HybridClock initialized: now 1786528389937240 us; error 60 us; skew 500 ppm
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:09.941597 26131 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:09.943396 26131 webserver.cc:460] Webserver started at http://127.11.118.190:43311/ using document root <none> and password file <none>
I20260812 09:53:09.944205 26131 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:09.944335 26131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 09:53:09 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:09.994583 26131 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:09.997592 26147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:09.999214 26131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:09.999373 26131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "80a034482e004a36862aa3ca4d4c53a0"
format_stamp: "Formatted at 2026-08-12 09:53:07 on dist-test-slave-2w3w"
server_key: "4766dffd5497a397c24ca9df7f3b65c1"
server_key_iv: "b7ec78bfaa9ad63f204e0973c852b26d"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:10.000012 26131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:10.026047 26131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:10.029757 26131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:10.030275 26131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:10.039091 26131 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:41675
I20260812 09:53:10.039139 26208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:41675 every 8 connection(s)
I20260812 09:53:10.040526 26131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:10.045770 26210 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:53:10.047695 26210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Bootstrap starting.
I20260812 09:53:10.049700 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26131
I20260812 09:53:10.050374 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:42131
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:41675
--webserver_port=45915
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:10.067095 26210 log.cc:824] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:10.074623 26210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:53:10.075217 26210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Bootstrap complete.
I20260812 09:53:10.079984 26210 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:10.080650 26210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a034482e004a36862aa3ca4d4c53a0, State: Initialized, Role: FOLLOWER
I20260812 09:53:10.082273 26210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:10.082479 26210 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:10.082590 26210 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:10.082729 26210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:53:10.085222 26210 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:10.085664 26210 leader_election.cc:302] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80a034482e004a36862aa3ca4d4c53a0; no voters:
I20260812 09:53:10.086102 26210 leader_election.cc:288] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 09:53:10.086205 26215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 09:53:10.086475 26215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [term 2 LEADER]: Becoming Leader. State: Replica: 80a034482e004a36862aa3ca4d4c53a0, State: Running, Role: LEADER
I20260812 09:53:10.086839 26215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } }
I20260812 09:53:10.087698 26210 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:10.088481 26216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "80a034482e004a36862aa3ca4d4c53a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } } }
I20260812 09:53:10.088665 26216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:10.089061 26217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a034482e004a36862aa3ca4d4c53a0. Latest consensus state: current_term: 2 leader_uuid: "80a034482e004a36862aa3ca4d4c53a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a034482e004a36862aa3ca4d4c53a0" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 41675 } } }
I20260812 09:53:10.089164 26217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:10.089708 26222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:10.094360 26222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:10.095175 26210 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 09:53:10.095278 26222 catalog_manager.cc:1259] Loaded cluster ID: d8a1d81f3be5419f8c0c767449968dc0
I20260812 09:53:10.095328 26222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:10.097440 26222 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:10.098127 26222 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Loaded TSK: 0
I20260812 09:53:10.099532 26222 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:53:10.226337 26212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:10.226766 26212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:10.226832 26212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:10.233309 26212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:10.233404 26212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:10.233498 26212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:10.241703 26212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:42131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=45915
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:10.243232 26212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:10.244647 26212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:10.260102 26251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:10.260016 26250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:10.260681 26212 server_base.cc:1034] running on GCE node
W20260812 09:53:10.260689 26253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:10.261268 26212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:10.262215 26212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:10.263432 26212 hybrid_clock.cc:648] HybridClock initialized: now 1786528390263413 us; error 38 us; skew 500 ppm
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:10.267498 26212 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:10.268791 26212 webserver.cc:460] Webserver started at http://127.11.118.129:45915/ using document root <none> and password file <none>
I20260812 09:53:10.269587 26212 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:10.269712 26212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:10.296527 26212 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260812 09:53:10.302783 26262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.304764 26212 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260812 09:53:10.304958 26212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "1a68a579405046b987e36ecf01601272"
format_stamp: "Formatted at 2026-08-12 09:53:08 on dist-test-slave-2w3w"
server_key: "0bf06aeeb56ef76cdbc9280af7d46fa1"
server_key_iv: "acac36f7a6d04dea6d596b4a362ef0c8"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:10.305789 26212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:10.327620 26212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:10.331341 26212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:10.331565 26212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:10.332368 26212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:10.333526 26212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:10.333611 26212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.333681 26212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:10.333714 26212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.345897 26212 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:42131
I20260812 09:53:10.345920 26395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:42131 every 8 connection(s)
I20260812 09:53:10.347146 26212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:10.352109 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26212
I20260812 09:53:10.352646 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:45249
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:41675
--webserver_port=39529
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:10.377072 26398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.349597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.129:49887)
0812 09:53:10.350094 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:10.350149 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:10.351087 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:10.359976 (+ 8889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:10.359988 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:10.360394 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:10.361154 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:10.361177 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.363668 (+ 2491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.363673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:10.365190 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:10.365208 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.366437 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.366443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:10.366663 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:10.367543 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:10.367568 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:10.369408 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:10.372480 (+ 3072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:10.372491 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:10.372509 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:10.373001 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:10.373556 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:10.373560 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:10.373562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:10.373841 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:10.374816 (+ 975us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:10.374824 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:10.375224 (+ 400us) client_negotiation.cc:769] Sending connection context
0812 09:53:10.375453 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 09:53:10.375877 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":156,"threads_started":1}
I20260812 09:53:10.379783 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.349541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:49887 (local address 127.11.118.190:41675)
0812 09:53:10.358120 (+ 8579us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:10.358151 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:10.358224 (+ 73us) server_negotiation.cc:407] Connection header received
0812 09:53:10.358647 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:10.358669 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:10.359293 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:10.361470 (+ 2177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:10.361824 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.363428 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.365403 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.366200 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.368486 (+ 2286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:10.369718 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:10.369728 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:10.369748 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:10.369805 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:10.372262 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:10.373206 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:10.373214 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:10.373220 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:10.373410 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:10.373988 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:10.373992 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:10.373993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:10.374609 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:10.377940 (+ 3331us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:10.378169 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 09:53:10.378625 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8324,"thread_start_us":126,"threads_started":1}
I20260812 09:53:10.383379 26396 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:10.383864 26396 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.384649 26396 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
W20260812 09:53:10.387972 26396 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:41675 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 09:53:10.388167 26396 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.388481 26396 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:10.389758 26396 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.390008 26396 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
W20260812 09:53:10.391013 26396 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:53:10.530012 26400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:10.530355 26400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:10.530402 26400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:10.535290 26400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:10.535403 26400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:10.535518 26400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:10.543973 26400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:45249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=39529
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:10.545324 26400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:10.546435 26400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:10.559259 26410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:10.559407 26409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:10.559695 26412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:10.560628 26400 server_base.cc:1034] running on GCE node
I20260812 09:53:10.561244 26400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:10.562237 26400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:10.563525 26400 hybrid_clock.cc:648] HybridClock initialized: now 1786528390563502 us; error 43 us; skew 500 ppm
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:10.567709 26400 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:10.569079 26400 webserver.cc:460] Webserver started at http://127.11.118.130:39529/ using document root <none> and password file <none>
I20260812 09:53:10.569947 26400 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:10.570137 26400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:10.607144 26400 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.004s sys 0.000s
I20260812 09:53:10.617260 26420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.619699 26400 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.000s
I20260812 09:53:10.619968 26400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "fa46616609f4448d853c14f2671dbb79"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "6de31501bcea5df259902f492d739afa"
server_key_iv: "69ed51ab5a1367855508481d7bc5348e"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:10.620747 26400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:10.661717 26400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:10.665957 26400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:10.666262 26400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:10.667163 26400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:10.668417 26400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:10.668545 26400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.668658 26400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:10.668732 26400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.682629 26400 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45249
I20260812 09:53:10.683198 26549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45249 every 8 connection(s)
I20260812 09:53:10.684232 26400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:10.691084 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26400
I20260812 09:53:10.691583 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.118.148:47413/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:45967
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:41675
--webserver_port=37685
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:34505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:10.708891 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.687072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:35075 (local address 127.11.118.190:41675)
0812 09:53:10.687339 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:10.687345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:10.688182 (+ 837us) server_negotiation.cc:407] Connection header received
0812 09:53:10.689928 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:10.689934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:10.690016 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:10.690179 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:10.692020 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.692851 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.694998 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.695393 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.695496 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:10.703442 (+ 7946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:10.703448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:10.703451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:10.703490 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:10.705837 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:10.706709 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:10.706713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:10.706715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:10.706836 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:10.707325 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:10.707329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:10.707331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:10.707597 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:10.707700 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:10.708533 (+ 833us) server_negotiation.cc:299] Negotiation successful
0812 09:53:10.708705 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 09:53:10.709844 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.687347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.130:35075)
0812 09:53:10.687982 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:10.688041 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:10.689396 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:10.690561 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:10.690574 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:10.691047 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:10.691791 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:10.691825 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.693076 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.693081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:10.694698 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:10.694718 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.695759 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.695762 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:10.696024 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:10.696896 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:10.696922 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:10.702608 (+ 5686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:10.706044 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:10.706056 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:10.706084 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:10.706564 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:10.706948 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:10.706952 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:10.706954 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:10.707197 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:10.707775 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:10.707783 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:10.708157 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 09:53:10.708377 (+ 220us) client_negotiation.cc:240] Negotiation successful
0812 09:53:10.708760 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":177,"threads_started":1}
I20260812 09:53:10.711309 26550 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:10.711627 26550 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.712299 26550 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
W20260812 09:53:10.714398 26550 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:41675 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 09:53:10.714547 26550 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.714781 26550 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:10.715814 26550 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:10.716033 26550 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
W20260812 09:53:10.718181 26550 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:53:10.854053 26553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:10.854624 26553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:10.854779 26553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:10.862161 26553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:10.862365 26553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:10.862567 26553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:10.869704 26553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:34505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.118.148:47413/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:45967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=37685
--tserver_master_addrs=127.11.118.190:41675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:10.871630 26553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:10.873087 26553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:10.886507 26565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:10.886507 26560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:10.887334 26562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:10.888231 26553 server_base.cc:1034] running on GCE node
I20260812 09:53:10.888876 26553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:10.889863 26553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:10.892144 26553 hybrid_clock.cc:648] HybridClock initialized: now 1786528390892113 us; error 58 us; skew 500 ppm
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:10.897011 26553 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:10.898411 26553 webserver.cc:460] Webserver started at http://127.11.118.131:37685/ using document root <none> and password file <none>
I20260812 09:53:10.899168 26553 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:10.899271 26553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 09:53:10 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:10.922140 26553 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.001s
I20260812 09:53:10.927816 26573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.929757 26553 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260812 09:53:10.929975 26553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "176cc6786b1d40cc9cdc2ab4d6993db2"
format_stamp: "Formatted at 2026-08-12 09:53:09 on dist-test-slave-2w3w"
server_key: "871af9d5daf46d66474c00156d90eba5"
server_key_iv: "6b9dd127b4a234b8563b1980c7d47602"
server_key_version: "kuduclusterkey@0"
I20260812 09:53:10.930647 26553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:10.967535 26553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:10.971638 26553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:10.971907 26553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:10.972888 26553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:10.974098 26553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:10.974187 26553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.974288 26553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:10.974336 26553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:10.987488 26553 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:45967
I20260812 09:53:10.987505 26703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:45967 every 8 connection(s)
I20260812 09:53:10.989084 26553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:10.993551 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26553
Aug 12 09:53:11 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:11.009799 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.994499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49346 (local address 127.11.118.190:41675)
0812 09:53:10.995343 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:10.995355 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:10.995370 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:53:10.995731 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:10.995736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:10.995835 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:10.997510 (+ 1675us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:10.997653 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.998554 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.000006 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.000364 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.000478 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.002941 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:11.002946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:11.002949 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:11.002999 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:11.006821 (+ 3822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.007518 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.007523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.007527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.007633 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.008009 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.008012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.008014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.008291 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:11.008515 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.009442 (+ 927us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.009595 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":767,"thread_start_us":129,"threads_started":1}
I20260812 09:53:11.010177 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.993038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:51307 (local address 127.11.118.190:41675)
0812 09:53:10.993178 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:10.993185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:10.993205 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:53:10.993855 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:10.993859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:10.993920 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:10.994029 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:10.997695 (+ 3666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.998575 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.000881 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.001241 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.001318 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.005218 (+ 3900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:11.005223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:11.005226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:11.005279 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:11.007153 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.007917 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.007920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.007922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.008011 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.008462 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.008466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.008468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.008686 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:11.008776 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.009799 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.010033 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:53:11.012109 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:10.991895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:41675 (local address 127.11.118.131:51307)
0812 09:53:10.992495 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:10.992553 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:10.993561 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:10.994234 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:10.994247 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:10.994652 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:10.995708 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:10.995755 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:10.998808 (+ 3053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:10.998812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.000615 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.000633 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.001536 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.001541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.001796 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.002685 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:11.002707 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:11.004963 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:11.007321 (+ 2358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:11.007329 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:11.007351 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:11.007785 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:11.008122 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:11.008125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:11.008127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:11.008341 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:11.008852 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:11.008860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:11.009238 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.009701 (+ 463us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.010832 (+ 1131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":193,"threads_started":1}
I20260812 09:53:11.013595 26704 heartbeater.cc:347] Connected to a master server at 127.11.118.190:41675
I20260812 09:53:11.013886 26704 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:11.014607 26704 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:11.016866 26170 ts_manager.cc:194] Registered new tserver with Master: 176cc6786b1d40cc9cdc2ab4d6993db2 (127.11.118.131:45967)
I20260812 09:53:11.018098 26170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:51307
I20260812 09:53:11.391268 26396 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:11.391595 26396 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
Aug 12 09:53:11 dist-test-slave-2w3w krb5kdc[25002](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786528391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:11.392560 26165 ts_manager.cc:194] Registered new tserver with Master: 1a68a579405046b987e36ecf01601272 (127.11.118.129:42131)
I20260812 09:53:11.393379 26165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:49887
I20260812 09:53:11.718500 26550 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:11.718869 26550 heartbeater.cc:511] Master 127.11.118.190:41675 requested a full tablet report, sending...
I20260812 09:53:11.719961 26165 ts_manager.cc:194] Registered new tserver with Master: fa46616609f4448d853c14f2671dbb79 (127.11.118.130:45249)
I20260812 09:53:11.720800 26165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:35075
I20260812 09:53:11.727458 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:53:11.741391 26732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.730030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49358 (local address 127.11.118.190:41675)
0812 09:53:11.730346 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.730351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.730368 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:53:11.730414 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.730417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.730472 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.731571 (+ 1099us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:11.731681 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.732519 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.733801 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.734137 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.734271 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.736340 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:11.736344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:11.736347 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:11.736382 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:11.738770 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.739418 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.739422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.739424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.739534 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:11.739890 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:11.739894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:11.739896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:11.740172 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:11.740975 (+ 803us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.741060 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.741204 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":104,"threads_started":1}
I20260812 09:53:11.746847 26165 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49358:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:53:11.752357 26165 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:53:11.784531 26746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.773554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.11.118.130:45249)
0812 09:53:11.774053 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.774061 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.775437 (+ 1376us) server_negotiation.cc:407] Connection header received
0812 09:53:11.775530 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.775537 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.775786 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.775946 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:11.776990 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.778246 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.781603 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.782487 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.782628 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.784185 (+ 1557us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.784249 (+ 64us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.784370 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":107,"threads_started":1}
I20260812 09:53:11.785000 26747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.773257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45249 (local address 127.0.0.1:56642)
0812 09:53:11.775005 (+ 1748us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.775075 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:11.775260 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:11.776404 (+ 1144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:11.776413 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:11.776439 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:11.776637 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.776645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.780123 (+ 3478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.780126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.781435 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.781446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.782867 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.782871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.783017 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.783068 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.783178 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.784858 (+ 1680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1538,"mutex_wait_us":7,"thread_start_us":109,"threads_started":1}
I20260812 09:53:11.786011 26737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.773994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:42131 (local address 127.0.0.1:39994)
0812 09:53:11.776649 (+ 2655us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.776661 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:11.776740 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:11.777367 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:11.777370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:11.777386 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:11.777487 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.777493 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.779962 (+ 2469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.779966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.781470 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.781483 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.785603 (+ 4120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.785607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.785701 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.785724 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.785807 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.785878 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2597,"mutex_wait_us":181,"thread_start_us":101,"threads_started":1}
I20260812 09:53:11.786450 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.774436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.11.118.129:42131)
0812 09:53:11.776266 (+ 1830us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.776276 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.776847 (+ 571us) server_negotiation.cc:407] Connection header received
0812 09:53:11.776929 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.776934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.777106 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.777226 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:11.777609 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.779817 (+ 2208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.782777 (+ 2960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.783675 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.783813 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.783953 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.786200 (+ 2247us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.786321 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1718,"thread_start_us":135,"threads_started":1}
I20260812 09:53:11.788192 26744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.772335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45967 (local address 127.0.0.1:37626)
0812 09:53:11.775611 (+ 3276us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.775626 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:11.775735 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:11.776492 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:11.776495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:11.776513 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:11.776843 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.776850 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.779815 (+ 2965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.779819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.782604 (+ 2785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.782619 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.787677 (+ 5058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.787682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.787789 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.787818 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.787901 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.787982 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1799,"mutex_wait_us":1605,"thread_start_us":154,"threads_started":1}
I20260812 09:53:11.789290 26742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.773176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37626 (local address 127.11.118.131:45967)
0812 09:53:11.775439 (+ 2263us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.775544 (+ 105us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.775900 (+ 356us) server_negotiation.cc:407] Connection header received
0812 09:53:11.775985 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.775990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.776194 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.776336 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:11.778446 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.779661 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.784040 (+ 4379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.785392 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.786511 (+ 1119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.788896 (+ 2385us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.788966 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.789079 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2146,"thread_start_us":94,"threads_started":1}
I20260812 09:53:11.788929 26468 tablet_service.cc:1467] Processing CreateTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a (DEFAULT_TABLE table=test-table [id=6f634e34b2cf4b2c9684dda1a18124d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:11.790256 26468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056cf4a0f5dc4a98adda847d40bc8a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:11.789796 26315 tablet_service.cc:1467] Processing CreateTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a (DEFAULT_TABLE table=test-table [id=6f634e34b2cf4b2c9684dda1a18124d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:11.791064 26315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056cf4a0f5dc4a98adda847d40bc8a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:11.793540 26624 tablet_service.cc:1467] Processing CreateTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a (DEFAULT_TABLE table=test-table [id=6f634e34b2cf4b2c9684dda1a18124d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:11.794716 26624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056cf4a0f5dc4a98adda847d40bc8a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:11.801363 26749 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Bootstrap starting.
I20260812 09:53:11.804112 26750 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Bootstrap starting.
I20260812 09:53:11.811394 26749 tablet_bootstrap.cc:654] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:11.812157 26750 tablet_bootstrap.cc:654] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:11.812592 26749 log.cc:824] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:11.813115 26750 log.cc:824] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:11.814100 26752 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Bootstrap starting.
I20260812 09:53:11.816601 26749 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: No bootstrap required, opened a new log
I20260812 09:53:11.816712 26750 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: No bootstrap required, opened a new log
I20260812 09:53:11.816963 26749 ts_tablet_manager.cc:1397] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.000s
I20260812 09:53:11.816969 26750 ts_tablet_manager.cc:1397] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260812 09:53:11.822461 26749 raft_consensus.cc:348] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.822638 26750 raft_consensus.cc:348] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.823045 26750 raft_consensus.cc:374] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:11.823061 26749 raft_consensus.cc:374] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:11.823174 26749 raft_consensus.cc:729] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa46616609f4448d853c14f2671dbb79, State: Initialized, Role: FOLLOWER
I20260812 09:53:11.823170 26750 raft_consensus.cc:729] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a68a579405046b987e36ecf01601272, State: Initialized, Role: FOLLOWER
I20260812 09:53:11.823756 26750 consensus_queue.cc:260] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.825035 26750 ts_tablet_manager.cc:1428] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260812 09:53:11.825479 26396 heartbeater.cc:503] Master 127.11.118.190:41675 was elected leader, sending a full tablet report...
I20260812 09:53:11.825762 26752 tablet_bootstrap.cc:654] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:11.825933 26749 consensus_queue.cc:260] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.826860 26752 log.cc:824] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:11.827342 26749 ts_tablet_manager.cc:1428] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260812 09:53:11.827708 26550 heartbeater.cc:503] Master 127.11.118.190:41675 was elected leader, sending a full tablet report...
I20260812 09:53:11.831063 26752 tablet_bootstrap.cc:492] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: No bootstrap required, opened a new log
I20260812 09:53:11.831372 26752 ts_tablet_manager.cc:1397] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260812 09:53:11.836797 26752 raft_consensus.cc:348] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.837189 26752 raft_consensus.cc:374] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:11.837318 26752 raft_consensus.cc:729] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176cc6786b1d40cc9cdc2ab4d6993db2, State: Initialized, Role: FOLLOWER
I20260812 09:53:11.838017 26752 consensus_queue.cc:260] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.839452 26704 heartbeater.cc:503] Master 127.11.118.190:41675 was elected leader, sending a full tablet report...
I20260812 09:53:11.840823 26752 ts_tablet_manager.cc:1428] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260812 09:53:11.842935 26756 raft_consensus.cc:482] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:11.843164 26756 raft_consensus.cc:504] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.844379 26756 leader_election.cc:288] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 176cc6786b1d40cc9cdc2ab4d6993db2 (127.11.118.131:45967), fa46616609f4448d853c14f2671dbb79 (127.11.118.130:45249)
I20260812 09:53:11.851351 26742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.844852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:39085 (local address 127.11.118.131:45967)
0812 09:53:11.845233 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.845238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.846193 (+ 955us) server_negotiation.cc:407] Connection header received
0812 09:53:11.846417 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.846421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.846474 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.846527 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:11.847037 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.847840 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.849717 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.850437 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.850553 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.850617 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.851092 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.851186 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281}
I20260812 09:53:11.851562 26746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.845224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:40823 (local address 127.11.118.130:45249)
0812 09:53:11.845349 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.845354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.845837 (+ 483us) server_negotiation.cc:407] Connection header received
0812 09:53:11.845992 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.845995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.846047 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.846135 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:11.846652 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.847525 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.850250 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.850839 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.850989 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.851040 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.851364 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.851444 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 09:53:11.852093 26760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.844687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45249 (local address 127.11.118.129:40823)
0812 09:53:11.845704 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.845722 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:11.845866 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:11.846286 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:11.846289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:11.846316 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:11.846489 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.846499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.848857 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.848863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.850089 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.850101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.851142 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.851145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.851238 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.851257 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.851754 (+ 497us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.851835 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":168,"threads_started":1}
I20260812 09:53:11.852248 26761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.844692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:45967 (local address 127.11.118.129:39085)
0812 09:53:11.846103 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.846119 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:11.846264 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:11.846684 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:11.846687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:11.846706 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:11.846844 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.846852 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.848014 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.848017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.849542 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:11.849555 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.850770 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.850774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:11.850890 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.850917 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:53:11.851935 (+ 1018us) client_negotiation.cc:240] Negotiation successful
0812 09:53:11.852028 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1337,"mutex_wait_us":565,"thread_start_us":137,"threads_started":1}
I20260812 09:53:11.853614 26629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056cf4a0f5dc4a98adda847d40bc8a3a" candidate_uuid: "1a68a579405046b987e36ecf01601272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" is_pre_election: true
I20260812 09:53:11.853777 26494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056cf4a0f5dc4a98adda847d40bc8a3a" candidate_uuid: "1a68a579405046b987e36ecf01601272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa46616609f4448d853c14f2671dbb79" is_pre_election: true
I20260812 09:53:11.854010 26629 raft_consensus.cc:2454] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a68a579405046b987e36ecf01601272 in term 0.
I20260812 09:53:11.854071 26494 raft_consensus.cc:2454] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a68a579405046b987e36ecf01601272 in term 0.
I20260812 09:53:11.854660 26263 leader_election.cc:302] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a68a579405046b987e36ecf01601272, fa46616609f4448d853c14f2671dbb79; no voters:
I20260812 09:53:11.855077 26756 raft_consensus.cc:2781] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:11.855159 26756 raft_consensus.cc:482] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:11.855197 26756 raft_consensus.cc:3037] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 09:53:11 dist-test-slave-2w3w krb5kdc[25002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for HTTP/127.11.118.148@KRBTEST.COM
I20260812 09:53:11.856580 26756 raft_consensus.cc:504] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
I20260812 09:53:11.857008 26756 leader_election.cc:288] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [CANDIDATE]: Term 1 election: Requested vote from peers 176cc6786b1d40cc9cdc2ab4d6993db2 (127.11.118.131:45967), fa46616609f4448d853c14f2671dbb79 (127.11.118.130:45249)
I20260812 09:53:11.857702 26494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056cf4a0f5dc4a98adda847d40bc8a3a" candidate_uuid: "1a68a579405046b987e36ecf01601272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa46616609f4448d853c14f2671dbb79"
I20260812 09:53:11.857712 26629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056cf4a0f5dc4a98adda847d40bc8a3a" candidate_uuid: "1a68a579405046b987e36ecf01601272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2"
I20260812 09:53:11.857857 26494 raft_consensus.cc:3037] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:11.857882 26629 raft_consensus.cc:3037] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:11.859273 26494 raft_consensus.cc:2454] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a68a579405046b987e36ecf01601272 in term 1.
I20260812 09:53:11.859509 26629 raft_consensus.cc:2454] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a68a579405046b987e36ecf01601272 in term 1.
I20260812 09:53:11.859838 26263 leader_election.cc:302] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a68a579405046b987e36ecf01601272, fa46616609f4448d853c14f2671dbb79; no voters:
I20260812 09:53:11.860106 26756 raft_consensus.cc:2781] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:11.860333 26756 raft_consensus.cc:686] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [term 1 LEADER]: Becoming Leader. State: Replica: 1a68a579405046b987e36ecf01601272, State: Running, Role: LEADER
I20260812 09:53:11.860703 26756 consensus_queue.cc:237] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } }
W20260812 09:53:11.861013 26397 tablet.cc:2369] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:11.867628 26165 catalog_manager.cc:5495] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a68a579405046b987e36ecf01601272 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "1a68a579405046b987e36ecf01601272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a68a579405046b987e36ecf01601272" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 42131 } health_report { overall_health: HEALTHY } } }
I20260812 09:53:11.893033 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.887392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.11.118.129:42131)
0812 09:53:11.887547 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:11.887553 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:11.887568 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:53:11.887674 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:11.887678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:11.887756 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:11.887894 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:53:11.888255 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.889086 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.890468 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:11.890803 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:11.890911 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:11.891466 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:53:11.892083 (+ 617us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:53:11.892218 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:11.892744 (+ 526us) server_negotiation.cc:299] Negotiation successful
0812 09:53:11.892825 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:53:11.901398 26494 raft_consensus.cc:1261] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 1 FOLLOWER]: Refusing update from remote peer 1a68a579405046b987e36ecf01601272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:11.902588 26762 consensus_queue.cc:1035] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa46616609f4448d853c14f2671dbb79" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:11.912206 26629 raft_consensus.cc:1261] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 1 FOLLOWER]: Refusing update from remote peer 1a68a579405046b987e36ecf01601272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:11.913244 26762 consensus_queue.cc:1035] T 056cf4a0f5dc4a98adda847d40bc8a3a P 1a68a579405046b987e36ecf01601272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176cc6786b1d40cc9cdc2ab4d6993db2" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 45967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:11.927549 26766 mvcc.cc:205] Tried to move back new op lower bound from 7317620293218369536 to 7317620293068902400. Current Snapshot: MvccSnapshot[applied={T|T < 7317620293218369536}]
I20260812 09:53:11.934069 26769 mvcc.cc:205] Tried to move back new op lower bound from 7317620293218369536 to 7317620293068902400. Current Snapshot: MvccSnapshot[applied={T|T < 7317620293218369536}]
I20260812 09:53:11.934695 26767 mvcc.cc:205] Tried to move back new op lower bound from 7317620293218369536 to 7317620293068902400. Current Snapshot: MvccSnapshot[applied={T|T < 7317620293218369536}]
I20260812 09:53:11.942018 26165 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:11.942210 26165 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:11.945168 26165 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 80a034482e004a36862aa3ca4d4c53a0: Sending DeleteTablet for 3 replicas of tablet 056cf4a0f5dc4a98adda847d40bc8a3a
I20260812 09:53:11.946216 26315 tablet_service.cc:1514] Processing DeleteTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:11 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:39994
I20260812 09:53:11.947320 26468 tablet_service.cc:1514] Processing DeleteTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:11 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:56642
I20260812 09:53:11.948199 26624 tablet_service.cc:1514] Processing DeleteTablet for tablet 056cf4a0f5dc4a98adda847d40bc8a3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:11 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:37626
I20260812 09:53:11.949222 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26212
I20260812 09:53:11.956063 26777 tablet_replica.cc:330] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: stopping tablet replica
I20260812 09:53:11.956805 26777 raft_consensus.cc:2229] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:11.956845 26778 tablet_replica.cc:330] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: stopping tablet replica
I20260812 09:53:11.957175 26778 raft_consensus.cc:2229] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:11.957393 26777 raft_consensus.cc:2258] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:11.957597 26778 raft_consensus.cc:2258] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:11.959316 26777 ts_tablet_manager.cc:1905] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:11.963900 26777 ts_tablet_manager.cc:1918] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:11.964160 26777 log.cc:1196] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/056cf4a0f5dc4a98adda847d40bc8a3a
I20260812 09:53:11.964689 26777 ts_tablet_manager.cc:1939] T 056cf4a0f5dc4a98adda847d40bc8a3a P fa46616609f4448d853c14f2671dbb79: Deleting consensus metadata
W20260812 09:53:11.965550 26151 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:42131 (error 108)
I20260812 09:53:11.966475 26148 catalog_manager.cc:4841] TS fa46616609f4448d853c14f2671dbb79 (127.11.118.130:45249): tablet 056cf4a0f5dc4a98adda847d40bc8a3a (table test-table [id=6f634e34b2cf4b2c9684dda1a18124d7]) successfully deleted
I20260812 09:53:11.966583 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26400
I20260812 09:53:11.971421 26778 ts_tablet_manager.cc:1905] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:11.975461 26744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:11.974988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:42131 (local address 127.0.0.1:40010)
0812 09:53:11.975237 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:11.975336 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260812 09:53:11.975678 26778 ts_tablet_manager.cc:1918] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:11.975919 26778 log.cc:1196] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/056cf4a0f5dc4a98adda847d40bc8a3a
W20260812 09:53:11.975867 26151 catalog_manager.cc:4584] TS 1a68a579405046b987e36ecf01601272 (127.11.118.129:42131): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 056cf4a0f5dc4a98adda847d40bc8a3a: Network error: Client connection negotiation failed: client connection to 127.11.118.129:42131: connect: Connection refused (error 111)
I20260812 09:53:11.976441 26778 ts_tablet_manager.cc:1939] T 056cf4a0f5dc4a98adda847d40bc8a3a P 176cc6786b1d40cc9cdc2ab4d6993db2: Deleting consensus metadata
I20260812 09:53:11.976732 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26553
I20260812 09:53:11.986119 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26131
I20260812 09:53:11.996733 11738 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 09:53:12.342751 11738 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 09:53:12.342880 11738 mini_ranger.cc:66] Stopping Ranger...
I20260812 09:53:12.689944 11738 mini_ranger.cc:68] Stopped Ranger
2026-08-12 09:53:12.690 UTC [25037] LOG: received smart shutdown request
2026-08-12 09:53:12.695 UTC [25037] LOG: background worker "logical replication launcher" (PID 25048) exited with exit code 1
2026-08-12 09:53:12.696 UTC [25043] LOG: shutting down
2026-08-12 09:53:12.918 UTC [25037] LOG: database system is shut down
2026-08-12T09:53:12Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55728 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:53:13 dist-test-slave-2w3w krb5kdc[26788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:53:13 dist-test-slave-2w3w krb5kdc[26788](info): set up 2 sockets
Aug 12 09:53:13 dist-test-slave-2w3w krb5kdc[26788](info): commencing operation
krb5kdc: starting...
W20260812 09:53:14.220233 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:53:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:53:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:53:14.371348 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39963
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:14.492532 26805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:14.492910 26805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:14.492993 26805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:14.497341 26805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:14.497475 26805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:14.497519 26805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:14.497560 26805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:14.497596 26805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:14.503553 26805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:14.504844 26805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:14.506565 26805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:53:14.517405 26805 server_base.cc:1034] running on GCE node
W20260812 09:53:14.517335 26813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:14.517329 26810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:14.517329 26811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:14.518523 26805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:14.519986 26805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:14.521270 26805 hybrid_clock.cc:648] HybridClock initialized: now 1786528394521248 us; error 68 us; skew 500 ppm
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:14.524784 26805 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:14.526003 26805 webserver.cc:460] Webserver started at http://127.11.118.190:39971/ using document root <none> and password file <none>
I20260812 09:53:14.526630 26805 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:14.526734 26805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:14.527064 26805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:14.529392 26805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "a64fdaf697c844fc9a787a107b846fb8"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6b88b0ced631761e70c3eb53d699df4e"
server_key_iv: "c9112750e755b3198dca17efff08918f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.530054 26805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "a64fdaf697c844fc9a787a107b846fb8"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6b88b0ced631761e70c3eb53d699df4e"
server_key_iv: "c9112750e755b3198dca17efff08918f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.534420 26805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 09:53:14.537683 26822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:14.539367 26805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:14.539597 26805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "a64fdaf697c844fc9a787a107b846fb8"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6b88b0ced631761e70c3eb53d699df4e"
server_key_iv: "c9112750e755b3198dca17efff08918f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.539758 26805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:14.553362 26805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:14.557209 26805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:14.557448 26805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:14.565677 26805 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:39963
I20260812 09:53:14.565996 26882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:39963 every 8 connection(s)
I20260812 09:53:14.566906 26805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:14.570125 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:14.570268 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26805
I20260812 09:53:14.570412 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:53:14.570749 11738 external_mini_cluster.cc:1428] Setting key 41a29ae4fc1b5c345ae9c179fcb3f564
I20260812 09:53:14.575263 26883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.118.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.189@KRBTEST.COM" created.
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:14.595602 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.578278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39963 (local address 127.0.0.1:60900)
0812 09:53:14.579079 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.579134 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:14.580245 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:14.581077 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:14.581083 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:14.581569 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:14.581832 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.581848 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.583283 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.583286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.584170 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.584181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.585275 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.585282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.585531 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.586479 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:14.586508 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:14.588537 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:14.591600 (+ 3063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.591611 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.591621 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.591963 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.592659 (+ 696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.592662 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.592663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.592823 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.593825 (+ 1002us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:14.593831 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:14.593987 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 09:53:14.594155 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 09:53:14.594483 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":197,"threads_started":1}
I20260812 09:53:14.595603 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.579579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60900 (local address 127.11.118.190:39963)
0812 09:53:14.579956 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:14.579968 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:14.580021 (+ 53us) server_negotiation.cc:407] Connection header received
0812 09:53:14.580636 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:14.580644 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:14.580873 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:14.581077 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:14.582013 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.583146 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.584296 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.585034 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.585252 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.588749 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:14.588758 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:14.588776 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:14.588812 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:14.591407 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.592113 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.592125 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.592129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.592487 (+ 358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.592942 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.592946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.592948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.593639 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:14.593811 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:14.594288 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 09:53:14.594634 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":263,"thread_start_us":127,"threads_started":1}
I20260812 09:53:14.598594 26883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:53:14.599624 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.599289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34334)
0812 09:53:14.599460 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.599548 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 09:53:14.599926 26824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
I20260812 09:53:14.601095 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.600783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34342)
0812 09:53:14.600920 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.601009 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 09:53:14.601342 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40747: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
I20260812 09:53:14.607546 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:40747
--webserver_interface=127.11.118.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:14.650663 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } attempt: 1
I20260812 09:53:14.651706 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.651386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34356)
0812 09:53:14.651550 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.651624 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 09:53:14.652591 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.652348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34358)
0812 09:53:14.652472 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.652525 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 09:53:14.652822 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40747: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
I20260812 09:53:14.721035 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } attempt: 2
I20260812 09:53:14.721961 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.721638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34364)
0812 09:53:14.721793 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.721867 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 09:53:14.722779 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.722544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34370)
0812 09:53:14.722658 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.722715 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 09:53:14.722991 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40747: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40747: connect: Connection refused (error 111)
W20260812 09:53:14.730494 26892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:14.730878 26892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:14.731019 26892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:14.735329 26892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:14.735432 26892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:14.735471 26892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:14.735529 26892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:14.735569 26892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:14.741472 26892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:40747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.118.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:14.742748 26892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:14.744103 26892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:14.753454 26898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:14.753440 26901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:14.753437 26899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:14.753752 26892 server_base.cc:1034] running on GCE node
I20260812 09:53:14.754576 26892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:14.755884 26892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:14.757109 26892 hybrid_clock.cc:648] HybridClock initialized: now 1786528394757081 us; error 44 us; skew 500 ppm
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:14.760373 26892 init.cc:377] Logged in from keytab as kudu/127.11.118.189@KRBTEST.COM (short username kudu)
I20260812 09:53:14.761360 26892 webserver.cc:460] Webserver started at http://127.11.118.189:38653/ using document root <none> and password file <none>
I20260812 09:53:14.761960 26892 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:14.762061 26892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:14.762308 26892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:14.764567 26892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data/instance:
uuid: "4318c4eb73c64ff283c205a1c50bab3c"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6381546949d5e06ba1d98d7d31b6c618"
server_key_iv: "544227fbc6ee573a3326a9844523535f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.765203 26892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal/instance:
uuid: "4318c4eb73c64ff283c205a1c50bab3c"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6381546949d5e06ba1d98d7d31b6c618"
server_key_iv: "544227fbc6ee573a3326a9844523535f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.769260 26892 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:53:14.772152 26910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:14.773563 26892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:14.773733 26892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "4318c4eb73c64ff283c205a1c50bab3c"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "6381546949d5e06ba1d98d7d31b6c618"
server_key_iv: "544227fbc6ee573a3326a9844523535f"
server_key_version: "encryptionkey@0"
I20260812 09:53:14.773867 26892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:14.787899 26892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:14.791659 26892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:14.791909 26892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:14.799450 26892 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.189:40747
I20260812 09:53:14.799747 26975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.189:40747 every 8 connection(s)
I20260812 09:53:14.800545 26892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
I20260812 09:53:14.803627 26976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:14.805944 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26892
I20260812 09:53:14.806109 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-1/wal/instance
I20260812 09:53:14.806398 11738 external_mini_cluster.cc:1428] Setting key 49ab7e4363ffca418bf3a7571b9cec32
I20260812 09:53:14.809059 26976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:53:14.814190 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } attempt: 3
WARNING: no policy specified for kudu/127.11.118.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.188@KRBTEST.COM" created.
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:53:14.827033 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.814755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34372)
0812 09:53:14.814985 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.815002 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:14.815081 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:14.815839 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:14.815842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:14.816045 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:14.816144 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.816150 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.817935 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.817938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.818836 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.818845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.819858 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.819862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.819970 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.820514 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:14.820531 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:14.822377 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:14.824977 (+ 2600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.824981 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.824983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.825198 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.825550 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.825556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.825560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.825703 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.826232 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:14.826238 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:14.826379 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 09:53:14.826520 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 09:53:14.826693 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"spinlock_wait_cycles":2304}
I20260812 09:53:14.828047 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.811832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39963 (local address 127.0.0.1:60916)
0812 09:53:14.812475 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.812524 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:14.813456 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:14.814044 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:14.814051 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:14.814518 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:14.815392 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.815416 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.816628 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.816633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.817914 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.817922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.818653 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.818656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.818839 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.819659 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:14.819685 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:14.821833 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:14.824245 (+ 2412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.824256 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.824270 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.824671 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.825045 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.825051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.825056 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.825264 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.825727 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:14.825736 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:14.826120 (+ 384us) client_negotiation.cc:769] Sending connection context
0812 09:53:14.826309 (+ 189us) client_negotiation.cc:240] Negotiation successful
0812 09:53:14.826687 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":3,"thread_start_us":206,"threads_started":1}
I20260812 09:53:14.828174 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.811216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.11.118.190:39963)
0812 09:53:14.811362 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:14.811365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:14.812665 (+ 1300us) server_negotiation.cc:407] Connection header received
0812 09:53:14.813690 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:14.813694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:14.813759 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:14.813837 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:14.815581 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.816479 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.818023 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.818454 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.818583 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.822008 (+ 3425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:14.822015 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:14.822019 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:14.822051 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:14.824101 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.824795 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.824802 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.824807 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.824914 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.825359 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.825362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.825363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.825614 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:14.825728 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:14.827873 (+ 2145us) server_negotiation.cc:299] Negotiation successful
0812 09:53:14.828017 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:53:14.828884 26980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.814912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34372 (local address 127.11.118.189:40747)
0812 09:53:14.815392 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:14.815404 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:14.815429 (+ 25us) server_negotiation.cc:407] Connection header received
0812 09:53:14.815474 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:14.815483 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:14.815676 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:14.815850 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:14.816296 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.817668 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.818998 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.819677 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.819804 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.822574 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:14.822584 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:14.822604 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:14.822637 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:14.824867 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.825323 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.825332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.825336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.825436 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.825812 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.825816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.825818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.826120 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:14.826257 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:14.826625 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 09:53:14.826757 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":253,"threads_started":1}
I20260812 09:53:14.829605 26976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:53:14.831251 26883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:53:14.832136 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.831797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60574)
0812 09:53:14.831985 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.832050 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 09:53:14.833065 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.832683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60580)
0812 09:53:14.832864 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.832962 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260812 09:53:14.833290 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:53:14.840480 26980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.830936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34384 (local address 127.11.118.189:40747)
0812 09:53:14.831085 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:14.831090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:14.831103 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:53:14.831140 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:14.831142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:14.831193 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:14.831286 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:14.831894 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.832661 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.833587 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.833924 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.834057 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.836787 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:14.836790 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:14.836793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:14.836816 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:14.838547 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.839088 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.839091 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.839093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.839178 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:14.839494 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:14.839499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:14.839501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:14.839713 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:14.839849 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:14.840126 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 09:53:14.840311 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":85}
I20260812 09:53:14.840480 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.830192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34384)
0812 09:53:14.830375 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.830391 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:14.830475 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:14.831295 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:14.831298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:14.831542 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:14.831691 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.831703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.832781 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.832785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.833475 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:14.833486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:14.834076 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:14.834079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:14.834212 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:14.835068 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:14.835097 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:14.836587 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:14.838690 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.838695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.838698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.838923 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.839301 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:14.839305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:14.839307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:14.839395 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:14.839834 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:14.839838 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:14.839943 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 09:53:14.840061 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 09:53:14.840248 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":19}
I20260812 09:53:14.841509 26976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:53:14.842446 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.842047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60590)
0812 09:53:14.842236 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.842357 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
W20260812 09:53:14.843510 26916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:14.843596 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:38445
--webserver_interface=127.11.118.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:14.844753 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.844434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60602)
0812 09:53:14.844587 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.844656 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 09:53:14.845062 26976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:14.864493 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 1
I20260812 09:53:14.865499 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.865119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60614)
0812 09:53:14.865306 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.865393 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 09:53:14.866402 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.866134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60622)
0812 09:53:14.866257 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.866318 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 09:53:14.866586 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:14.894426 26976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 1
I20260812 09:53:14.895700 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.895300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60626)
0812 09:53:14.895513 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.895593 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260812 09:53:14.896661 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.896392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60638)
0812 09:53:14.896520 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.896584 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 09:53:14.896819 26976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:14.941825 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 2
I20260812 09:53:14.942930 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.942541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60642)
0812 09:53:14.942739 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.942804 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260812 09:53:14.943813 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.943590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60656)
0812 09:53:14.943702 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.943757 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 09:53:14.943956 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:14.965010 26976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 2
I20260812 09:53:14.966042 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.965663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60658)
0812 09:53:14.965883 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.965954 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260812 09:53:14.967214 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:14.966741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60670)
0812 09:53:14.966946 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:14.967135 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260812 09:53:14.967422 26976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
W20260812 09:53:14.968765 26985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:14.969108 26985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:14.969213 26985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:14.973758 26985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:14.973878 26985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:14.973927 26985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:14.973966 26985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:14.973999 26985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:14.980132 26985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:39963,127.11.118.189:40747,127.11.118.188:38445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:38445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.118.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:14.981413 26985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:14.982798 26985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:14.992221 26991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:14.992426 26985 server_base.cc:1034] running on GCE node
W20260812 09:53:14.992277 26994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:14.992225 26992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:14.993372 26985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:14.994743 26985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:14.995985 26985 hybrid_clock.cc:648] HybridClock initialized: now 1786528394995938 us; error 64 us; skew 500 ppm
Aug 12 09:53:14 dist-test-slave-2w3w krb5kdc[26788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:14.999343 26985 init.cc:377] Logged in from keytab as kudu/127.11.118.188@KRBTEST.COM (short username kudu)
I20260812 09:53:15.000566 26985 webserver.cc:460] Webserver started at http://127.11.118.188:34705/ using document root <none> and password file <none>
I20260812 09:53:15.001206 26985 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:15.001314 26985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:15.001585 26985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:15.003976 26985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data/instance:
uuid: "b23ae6fe81cd4d14b42f43a71bfca01a"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "9ab399c3ed13fd3fc8eb6cae4fa0b79a"
server_key_iv: "aa6530556ba60c19edd23a0e933015ca"
server_key_version: "encryptionkey@0"
I20260812 09:53:15.004626 26985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal/instance:
uuid: "b23ae6fe81cd4d14b42f43a71bfca01a"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "9ab399c3ed13fd3fc8eb6cae4fa0b79a"
server_key_iv: "aa6530556ba60c19edd23a0e933015ca"
server_key_version: "encryptionkey@0"
I20260812 09:53:15.008947 26985 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:53:15.012274 27002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:15.013887 26985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:53:15.014087 26985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "b23ae6fe81cd4d14b42f43a71bfca01a"
format_stamp: "Formatted at 2026-08-12 09:53:14 on dist-test-slave-2w3w"
server_key: "9ab399c3ed13fd3fc8eb6cae4fa0b79a"
server_key_iv: "aa6530556ba60c19edd23a0e933015ca"
server_key_version: "encryptionkey@0"
I20260812 09:53:15.014276 26985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:15.043114 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 3
I20260812 09:53:15.044001 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.043620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60674)
0812 09:53:15.043813 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.043877 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 09:53:15.045063 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.044701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60680)
0812 09:53:15.044914 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.044976 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 09:53:15.045286 26883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:15.058646 26976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 3
I20260812 09:53:15.059414 26985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:15.059746 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.059434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60684)
0812 09:53:15.059583 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.059651 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260812 09:53:15.060530 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.060257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60688)
0812 09:53:15.060410 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.060470 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260812 09:53:15.060698 26976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:38445: Network error: Client connection negotiation failed: client connection to 127.11.118.188:38445: connect: Connection refused (error 111)
I20260812 09:53:15.063401 26985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:15.063621 26985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:15.071722 26985 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.188:38445
I20260812 09:53:15.072069 27066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.188:38445 every 8 connection(s)
I20260812 09:53:15.072831 26985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
I20260812 09:53:15.073829 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 26985
I20260812 09:53:15.073972 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786528216186196-11738-0/minicluster-data/master-2/wal/instance
I20260812 09:53:15.074301 11738 external_mini_cluster.cc:1428] Setting key b099b3e9c739d715e2c14684658a9db0
I20260812 09:53:15.076565 27067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:15.081243 27067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:53:15.090649 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.075874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60700 (local address 127.11.118.188:38445)
0812 09:53:15.076317 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.076343 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.076382 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:53:15.077137 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.077184 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.077580 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.077973 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.078937 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.080068 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.080997 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.081516 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.081702 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.085058 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.085063 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.085078 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.085109 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.087190 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.087718 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.087724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.087729 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.087852 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.088163 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.088168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.088170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.088611 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.088838 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.089132 (+ 294us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.089507 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":161,"threads_started":1}
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:15.097661 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.083765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60928 (local address 127.11.118.190:39963)
0812 09:53:15.083921 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.083971 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.084559 (+ 588us) server_negotiation.cc:407] Connection header received
0812 09:53:15.084775 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.084779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.084837 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.084947 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.086008 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.086844 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.088073 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.088600 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.088761 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.092001 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.092005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.092007 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.092039 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.095239 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.096048 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.096053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.096055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.096173 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.096513 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.096517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.096519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.096764 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.096896 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.097300 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.097457 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:53:15.097688 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.083676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39963 (local address 127.0.0.1:60928)
0812 09:53:15.084377 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.084450 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:15.084658 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:15.085011 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:15.085018 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:15.085648 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:15.085851 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.085860 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.087058 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.087062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.087874 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.087886 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.088763 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.088767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.088948 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.089614 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:15.089629 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:15.091796 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:15.095497 (+ 3701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.095516 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.095525 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.095911 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.096298 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.096302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.096303 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.096399 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.096899 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:15.096910 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:15.097051 (+ 141us) client_negotiation.cc:769] Sending connection context
0812 09:53:15.097226 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 09:53:15.097465 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":146,"threads_started":1}
I20260812 09:53:15.099089 27067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:53:15.108098 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.095263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.11.118.190:39963)
0812 09:53:15.095914 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.095935 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.095953 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:53:15.096034 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.096037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.096099 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.096273 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.097025 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.097621 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.098720 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.099080 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.099199 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.103205 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.103209 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.103211 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.103246 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.105487 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.106166 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.106171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.106172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.106290 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.106663 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.106666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.106667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.107089 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.107313 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.107606 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.107779 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":145,"threads_started":1}
I20260812 09:53:15.111006 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.099757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40747 (local address 127.0.0.1:34390)
0812 09:53:15.099977 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.099990 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:15.100058 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:15.100530 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:15.100532 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:15.100699 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:15.100883 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.100890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.101905 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.101909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.102618 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.102630 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.103422 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.103426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.103547 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.104309 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:15.104328 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:15.106197 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:15.108771 (+ 2574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.108775 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.108778 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.109187 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.109624 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.109627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.109629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.109733 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.110320 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:15.110327 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:15.110451 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 09:53:15.110592 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 09:53:15.110787 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260812 09:53:15.111003 26980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.099872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.11.118.189:40747)
0812 09:53:15.100036 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.100042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.100059 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:53:15.100237 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.100244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.100319 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.100460 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.101023 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.101680 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.102903 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.103267 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.103405 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.106403 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.106408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.106411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.106457 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.108478 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.109334 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.109341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.109346 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.109503 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.109844 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.109847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.109849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.110117 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.110254 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.110674 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.110801 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 09:53:15.111899 27067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:53:15.122589 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.112602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60714 (local address 127.11.118.188:38445)
0812 09:53:15.112725 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.112728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.112741 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:53:15.112857 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.112863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.112997 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.113090 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.113564 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.114523 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.115558 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.115794 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.115888 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.118683 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.118687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.118697 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.118720 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.120613 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.121093 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.121098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.121100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.121177 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.121465 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.121468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.121470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.121747 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.121849 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.122198 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.122368 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":38}
I20260812 09:53:15.122623 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.110225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34394 (local address 127.11.118.189:40747)
0812 09:53:15.110645 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.110652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.110665 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:53:15.110697 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.110699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.110735 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.110842 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.111742 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.112770 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.114079 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.114467 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.114602 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.118513 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.118516 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.118518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.118551 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.120574 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.121218 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.121223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.121225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.121327 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.121690 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.121693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.121695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.121912 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.122177 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.122298 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.122439 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":180,"threads_started":1}
I20260812 09:53:15.122702 27071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.112536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60714)
0812 09:53:15.112665 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.112681 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:15.112763 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:15.113124 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:15.113127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:15.113328 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:15.113425 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.113432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.114665 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.114669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.115370 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.115381 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.115930 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.115936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.116085 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.116659 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:15.116680 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:15.118510 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:15.120766 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.120769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.120771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.120988 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.121277 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.121280 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.121282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.121370 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.121831 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:15.121834 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:15.121921 (+ 87us) client_negotiation.cc:769] Sending connection context
0812 09:53:15.122037 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 09:53:15.122306 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 09:53:15.126680 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:53:15.127467 27067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: Bootstrap starting.
I20260812 09:53:15.131317 27067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:15.132609 27067 log.cc:824] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:15.138550 27067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: No bootstrap required, opened a new log
I20260812 09:53:15.142319 27073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.129332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34408 (local address 127.11.118.189:40747)
0812 09:53:15.129466 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.129471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.129763 (+ 292us) server_negotiation.cc:407] Connection header received
0812 09:53:15.130357 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.130362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.130437 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.130534 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.132172 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.133068 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.134022 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.134302 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.134483 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.136530 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.136536 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.136540 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.136581 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.139700 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.140265 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.140269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.140271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.140578 (+ 307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.141140 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.141143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.141145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.141385 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.141529 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.141996 (+ 467us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.142143 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 09:53:15.142282 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.129332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.11.118.188:38445)
0812 09:53:15.129465 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.129471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.129793 (+ 322us) server_negotiation.cc:407] Connection header received
0812 09:53:15.129983 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.129987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.130052 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.130110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.132359 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.133343 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.134561 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.134952 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.135075 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.137256 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.137262 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.137264 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.137288 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.139091 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.139778 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.139782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.139784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.139907 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.140251 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.140259 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.140262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.140583 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.140703 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.141732 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.141901 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:53:15.142944 27072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.129023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.11.118.190:39963)
0812 09:53:15.129582 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.129587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.130075 (+ 488us) server_negotiation.cc:407] Connection header received
0812 09:53:15.130247 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.130250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.130302 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.130358 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.132540 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.133593 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.134802 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.135174 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.135723 (+ 549us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.137149 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.137153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.137155 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.137207 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.139047 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.139778 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.139782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.139784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.140090 (+ 306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.140432 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.140434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.140436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.140675 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.141613 (+ 938us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.142346 (+ 733us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.142738 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469}
I20260812 09:53:15.144269 27067 raft_consensus.cc:348] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.144629 27067 raft_consensus.cc:374] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:15.144690 27067 raft_consensus.cc:729] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23ae6fe81cd4d14b42f43a71bfca01a, State: Initialized, Role: FOLLOWER
I20260812 09:53:15.145226 27067 consensus_queue.cc:260] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.145853 27082 sys_catalog.cc:455] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.145982 27082 sys_catalog.cc:458] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.146584 27067 sys_catalog.cc:564] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: configured and running, proceeding with master startup.
W20260812 09:53:15.152958 27095 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:53:15.153085 27095 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:53:15.151057 26985 master_runner.cc:186] Error getting master registration for 127.11.118.190:39963: OK, instance_id { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" instance_seqno: 1786528394563413 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 09:53:15.154757 26985 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 09:53:15.203907 26976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 4
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:53:15.209529 26883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } attempt: 4
I20260812 09:53:15.214049 27070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.204555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60726 (local address 127.11.118.188:38445)
0812 09:53:15.204712 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.204717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.204730 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:53:15.204872 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.204875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.204926 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.205013 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.205454 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.206000 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.206767 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.207062 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.207175 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.209758 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.209762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.209765 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.209799 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.212027 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.212607 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.212611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.212613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.212714 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.213052 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.213054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.213056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.213323 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.213473 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.213754 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.213878 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 09:53:15.214092 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.204476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60726)
0812 09:53:15.204630 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.204647 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:15.204737 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:15.205032 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:15.205035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:15.205240 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:15.205334 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.205339 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.206115 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.206121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.206646 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.206654 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.207183 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.207186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.207275 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.207915 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:15.207928 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:15.209570 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:15.212172 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.212176 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.212179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.212490 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.212822 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.212826 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.212828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.212937 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.213455 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:15.213458 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:15.213578 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 09:53:15.213696 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 09:53:15.213872 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
Aug 12 09:53:15 dist-test-slave-2w3w krb5kdc[26788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528394, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:53:15.218405 26976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: Bootstrap starting.
I20260812 09:53:15.222371 26976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:15.223484 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.210324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:38445 (local address 127.0.0.1:60738)
0812 09:53:15.210757 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:15.210775 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:15.211046 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:15.211616 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:15.211619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:15.211822 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:15.211920 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.211926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.213015 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.213019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.213960 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:15.213972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.214984 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.214991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:15.215088 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.216461 (+ 1373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:15.216476 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:15.218192 (+ 1716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:15.220954 (+ 2762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.220959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.220962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.221313 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.221989 (+ 676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:15.221993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:15.221996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:15.222118 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:15.222787 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:15.222791 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:15.222918 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 09:53:15.223087 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 09:53:15.223272 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327}
I20260812 09:53:15.223747 26976 log.cc:824] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:15.223855 27097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:15.210392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60738 (local address 127.11.118.188:38445)
0812 09:53:15.210814 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:15.210827 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:15.210841 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:53:15.211429 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:15.211434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:15.211493 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:15.211590 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:15.212053 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.212888 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.214172 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:15.214809 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:15.214934 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:15.218354 (+ 3420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:15.218358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:15.218361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:15.218390 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:15.220609 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.221506 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.221510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.221512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.221631 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:15.222268 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:15.222273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:15.222278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:15.222657 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:15.222787 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:15.223167 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 09:53:15.223315 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":153,"threads_started":1}
I20260812 09:53:15.227844 26976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: No bootstrap required, opened a new log
I20260812 09:53:15.228629 26883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: Bootstrap starting.
I20260812 09:53:15.231171 26883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:15.232070 26883 log.cc:824] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:15.232592 26976 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.232885 26976 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:15.232961 26976 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4318c4eb73c64ff283c205a1c50bab3c, State: Initialized, Role: FOLLOWER
I20260812 09:53:15.233520 26976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.234138 27101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.234367 27101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.234751 26883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: No bootstrap required, opened a new log
I20260812 09:53:15.235190 26976 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:15.238859 26883 raft_consensus.cc:348] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.239193 26883 raft_consensus.cc:374] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:15.239252 26883 raft_consensus.cc:729] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a64fdaf697c844fc9a787a107b846fb8, State: Initialized, Role: FOLLOWER
I20260812 09:53:15.239863 26883 consensus_queue.cc:260] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.241456 26883 sys_catalog.cc:564] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:15.239812 26892 master_runner.cc:186] Error getting master registration for 127.11.118.190:39963: OK, instance_id { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" instance_seqno: 1786528394563413 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 09:53:15.243595 26892 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 09:53:15.246135 27115 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:53:15.246328 27115 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:53:15.247758 27117 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
W20260812 09:53:15.248040 27131 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:53:15.248142 27131 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:53:15.248075 27117 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.252331 26805 master_runner.cc:263] No leader master found from master a64fdaf697c844fc9a787a107b846fb8
I20260812 09:53:15.252439 26805 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 09:53:15.293869 26920 tablet.cc:2369] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:53:15.309478 26829 tablet.cc:2369] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:53:15.315258 27008 tablet.cc:2369] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:15.381383 27117 raft_consensus.cc:482] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:15.381632 27117 raft_consensus.cc:504] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.382810 27117 leader_election.cc:288] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4318c4eb73c64ff283c205a1c50bab3c (127.11.118.189:40747), b23ae6fe81cd4d14b42f43a71bfca01a (127.11.118.188:38445)
I20260812 09:53:15.383096 27082 raft_consensus.cc:482] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:15.383285 27082 raft_consensus.cc:504] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.384301 27082 leader_election.cc:288] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a64fdaf697c844fc9a787a107b846fb8 (127.11.118.190:39963), 4318c4eb73c64ff283c205a1c50bab3c (127.11.118.189:40747)
I20260812 09:53:15.384775 26947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64fdaf697c844fc9a787a107b846fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4318c4eb73c64ff283c205a1c50bab3c" is_pre_election: true
I20260812 09:53:15.385100 26947 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a64fdaf697c844fc9a787a107b846fb8 in term 0.
I20260812 09:53:15.385255 26853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a64fdaf697c844fc9a787a107b846fb8" is_pre_election: true
I20260812 09:53:15.385496 26853 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23ae6fe81cd4d14b42f43a71bfca01a in term 0.
I20260812 09:53:15.385824 26947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4318c4eb73c64ff283c205a1c50bab3c" is_pre_election: true
I20260812 09:53:15.385960 26947 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b23ae6fe81cd4d14b42f43a71bfca01a in term 0.
I20260812 09:53:15.386162 26824 leader_election.cc:302] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4318c4eb73c64ff283c205a1c50bab3c, a64fdaf697c844fc9a787a107b846fb8; no voters:
I20260812 09:53:15.386319 27003 leader_election.cc:302] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4318c4eb73c64ff283c205a1c50bab3c, b23ae6fe81cd4d14b42f43a71bfca01a; no voters:
I20260812 09:53:15.386710 27082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:15.386802 27082 raft_consensus.cc:482] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:15.386845 27082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:15.387023 27117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:15.387123 27117 raft_consensus.cc:482] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:15.387179 27117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:15.388449 27082 raft_consensus.cc:504] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.389355 26947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4318c4eb73c64ff283c205a1c50bab3c"
I20260812 09:53:15.389514 26947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:15.389528 26853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a64fdaf697c844fc9a787a107b846fb8"
I20260812 09:53:15.389878 27117 raft_consensus.cc:504] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.390419 27117 leader_election.cc:288] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [CANDIDATE]: Term 1 election: Requested vote from peers 4318c4eb73c64ff283c205a1c50bab3c (127.11.118.189:40747), b23ae6fe81cd4d14b42f43a71bfca01a (127.11.118.188:38445)
I20260812 09:53:15.390612 26853 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b23ae6fe81cd4d14b42f43a71bfca01a in current term 1: Already voted for candidate a64fdaf697c844fc9a787a107b846fb8 in this term.
I20260812 09:53:15.390939 26947 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b23ae6fe81cd4d14b42f43a71bfca01a in term 1.
I20260812 09:53:15.391425 27003 leader_election.cc:302] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4318c4eb73c64ff283c205a1c50bab3c, b23ae6fe81cd4d14b42f43a71bfca01a; no voters:
I20260812 09:53:15.392266 27037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64fdaf697c844fc9a787a107b846fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" is_pre_election: true
I20260812 09:53:15.392575 26947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64fdaf697c844fc9a787a107b846fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4318c4eb73c64ff283c205a1c50bab3c"
I20260812 09:53:15.392758 26947 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a64fdaf697c844fc9a787a107b846fb8 in current term 1: Already voted for candidate b23ae6fe81cd4d14b42f43a71bfca01a in this term.
I20260812 09:53:15.392750 27036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64fdaf697c844fc9a787a107b846fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a"
I20260812 09:53:15.392360 27133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:15.393252 26826 leader_election.cc:302] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64fdaf697c844fc9a787a107b846fb8; no voters: 4318c4eb73c64ff283c205a1c50bab3c, b23ae6fe81cd4d14b42f43a71bfca01a
I20260812 09:53:15.393352 27133 raft_consensus.cc:686] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [term 1 LEADER]: Becoming Leader. State: Replica: b23ae6fe81cd4d14b42f43a71bfca01a, State: Running, Role: LEADER
I20260812 09:53:15.393620 27117 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 09:53:15.393855 27133 consensus_queue.cc:237] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } }
I20260812 09:53:15.393968 27082 leader_election.cc:288] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [CANDIDATE]: Term 1 election: Requested vote from peers a64fdaf697c844fc9a787a107b846fb8 (127.11.118.190:39963), 4318c4eb73c64ff283c205a1c50bab3c (127.11.118.189:40747)
I20260812 09:53:15.397627 27082 sys_catalog.cc:455] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b23ae6fe81cd4d14b42f43a71bfca01a. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.397801 27082 sys_catalog.cc:458] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:15.398880 27136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:15.400008 27136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:15.405774 26947 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [term 1 FOLLOWER]: Refusing update from remote peer b23ae6fe81cd4d14b42f43a71bfca01a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:15.405858 26853 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [term 1 FOLLOWER]: Refusing update from remote peer b23ae6fe81cd4d14b42f43a71bfca01a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:15.406464 27133 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:15.406643 27082 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:15.411221 27117 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b23ae6fe81cd4d14b42f43a71bfca01a. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.411455 27117 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.411646 27101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b23ae6fe81cd4d14b42f43a71bfca01a. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.411803 27101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.415282 27082 sys_catalog.cc:455] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.415472 27082 sys_catalog.cc:458] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:15.416268 27137 mvcc.cc:205] Tried to move back new op lower bound from 7317620307574378496 to 7317620307536445440. Current Snapshot: MvccSnapshot[applied={T|T < 7317620307574378496}]
I20260812 09:53:15.417344 27101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.417483 27101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.418089 27134 sys_catalog.cc:455] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.418226 27134 sys_catalog.cc:458] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:15.419730 27117 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a64fdaf697c844fc9a787a107b846fb8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39963 } } peers { permanent_uuid: "4318c4eb73c64ff283c205a1c50bab3c" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40747 } } peers { permanent_uuid: "b23ae6fe81cd4d14b42f43a71bfca01a" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 38445 } } }
I20260812 09:53:15.419870 27117 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:53:15.420624 27138 mvcc.cc:205] Tried to move back new op lower bound from 7317620307574378496 to 7317620307536445440. Current Snapshot: MvccSnapshot[applied={T|T < 7317620307574378496}]
I20260812 09:53:15.421193 27139 mvcc.cc:205] Tried to move back new op lower bound from 7317620307574378496 to 7317620307536445440. Current Snapshot: MvccSnapshot[applied={T|T < 7317620307574378496}]
I20260812 09:53:15.423032 27136 catalog_manager.cc:1347] Generated new cluster ID: 182f66a3ed8f44a99f7039bbefcaee48
I20260812 09:53:15.423300 27136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:15.468086 27136 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:53:15.469408 27136 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:15.481642 27136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b23ae6fe81cd4d14b42f43a71bfca01a: Generated new TSK 0
I20260812 09:53:15.482501 27136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:53:16.248060 27115 catalog_manager.cc:1259] Loaded cluster ID: 182f66a3ed8f44a99f7039bbefcaee48
I20260812 09:53:16.248152 27115 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: loading cluster ID for follower catalog manager: success
I20260812 09:53:16.249432 27131 catalog_manager.cc:1259] Loaded cluster ID: 182f66a3ed8f44a99f7039bbefcaee48
I20260812 09:53:16.249521 27131 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: loading cluster ID for follower catalog manager: success
I20260812 09:53:16.250448 27115 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: acquiring CA information for follower catalog manager: success
I20260812 09:53:16.251546 27131 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: acquiring CA information for follower catalog manager: success
I20260812 09:53:16.251968 27115 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4318c4eb73c64ff283c205a1c50bab3c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:53:16.252658 27131 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a64fdaf697c844fc9a787a107b846fb8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:53:16.553985 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26805
I20260812 09:53:16.563496 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26892
I20260812 09:53:16.573242 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 26985
2026-08-12T09:53:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3516 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:53:16 dist-test-slave-2w3w krb5kdc[27152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:53:16 dist-test-slave-2w3w krb5kdc[27152](info): set up 2 sockets
Aug 12 09:53:16 dist-test-slave-2w3w krb5kdc[27152](info): commencing operation
krb5kdc: starting...
W20260812 09:53:17.732802 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.006s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:53:17 dist-test-slave-2w3w krb5kdc[27152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:53:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:53:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:53:17.879881 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44801
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:44801
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:17.997561 27167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:17.997927 27167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:17.998014 27167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:18.002256 27167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:18.002386 27167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:18.002425 27167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:18.002465 27167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:18.002499 27167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:18.008324 27167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:44801
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:44801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:18.009567 27167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:18.010674 27167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:18.020224 27176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:18.020228 27174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:18.020289 27167 server_base.cc:1034] running on GCE node
W20260812 09:53:18.020231 27173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:18.021195 27167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:18.022435 27167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:18.023615 27167 hybrid_clock.cc:648] HybridClock initialized: now 1786528398023597 us; error 33 us; skew 500 ppm
Aug 12 09:53:18 dist-test-slave-2w3w krb5kdc[27152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528398, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:18.026765 27167 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:18.027935 27167 webserver.cc:460] Webserver started at http://127.11.118.190:46111/ using document root <none> and password file <none>
I20260812 09:53:18.028544 27167 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:18.028642 27167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:18.028947 27167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:18.031183 27167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "b7b1dce27242415997f8d67f5652990e"
format_stamp: "Formatted at 2026-08-12 09:53:18 on dist-test-slave-2w3w"
server_key: "dae8f8848f4da889bdd8ee0efc055646"
server_key_iv: "ab43de30302b6b37cee46b86e0698467"
server_key_version: "encryptionkey@0"
I20260812 09:53:18.031808 27167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "b7b1dce27242415997f8d67f5652990e"
format_stamp: "Formatted at 2026-08-12 09:53:18 on dist-test-slave-2w3w"
server_key: "dae8f8848f4da889bdd8ee0efc055646"
server_key_iv: "ab43de30302b6b37cee46b86e0698467"
server_key_version: "encryptionkey@0"
I20260812 09:53:18.035884 27167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:53:18.039476 27184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:18.041374 27167 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:53:18.041536 27167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "b7b1dce27242415997f8d67f5652990e"
format_stamp: "Formatted at 2026-08-12 09:53:18 on dist-test-slave-2w3w"
server_key: "dae8f8848f4da889bdd8ee0efc055646"
server_key_iv: "ab43de30302b6b37cee46b86e0698467"
server_key_version: "encryptionkey@0"
I20260812 09:53:18.041697 27167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:18.072567 27167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:18.076156 27167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:18.076333 27167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:18.084101 27167 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:44801
I20260812 09:53:18.084131 27245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:44801 every 8 connection(s)
I20260812 09:53:18.085367 27167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:18.088444 27246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:18.088855 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27167
I20260812 09:53:18.089000 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:53:18.089289 11738 external_mini_cluster.cc:1428] Setting key f0c2d2aea56782a397f2c424d62f7c6c
I20260812 09:53:18.096107 27246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e: Bootstrap starting.
I20260812 09:53:18.098524 27246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:18.099483 27246 log.cc:824] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:53:18 dist-test-slave-2w3w krb5kdc[27152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:18.101780 27246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e: No bootstrap required, opened a new log
I20260812 09:53:18.106125 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:18.090733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.11.118.190:44801)
0812 09:53:18.091459 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:18.091477 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:18.091515 (+ 38us) server_negotiation.cc:407] Connection header received
0812 09:53:18.092575 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:18.092596 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:18.092976 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:18.093397 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:18.094357 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:18.095610 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:18.096678 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:18.097216 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:18.097414 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:18.100668 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:18.100674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:18.100690 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:18.100718 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:18.102801 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:18.103375 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:18.103380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:18.103385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:18.103509 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:18.103878 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:18.103881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:18.103882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:18.104322 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:18.104485 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:18.104900 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 09:53:18.105300 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":368,"threads_started":1}
I20260812 09:53:18.106114 27246 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } }
I20260812 09:53:18.106469 27246 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:18.106549 27246 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7b1dce27242415997f8d67f5652990e, State: Initialized, Role: FOLLOWER
I20260812 09:53:18.107108 27246 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } }
I20260812 09:53:18.107292 27246 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:18.107368 27246 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:18.107496 27246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:18.108620 27246 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } }
I20260812 09:53:18.108996 27246 leader_election.cc:302] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7b1dce27242415997f8d67f5652990e; no voters:
I20260812 09:53:18.109448 27246 leader_election.cc:288] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:53:18.109589 27251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:18.109597 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:53:18.109800 27251 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [term 1 LEADER]: Becoming Leader. State: Replica: b7b1dce27242415997f8d67f5652990e, State: Running, Role: LEADER
I20260812 09:53:18.110097 27251 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } }
I20260812 09:53:18.110807 27246 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:18.111966 27252 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7b1dce27242415997f8d67f5652990e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } } }
I20260812 09:53:18.112123 27252 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:18.112432 27253 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7b1dce27242415997f8d67f5652990e. Latest consensus state: current_term: 1 leader_uuid: "b7b1dce27242415997f8d67f5652990e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7b1dce27242415997f8d67f5652990e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 44801 } } }
I20260812 09:53:18.112546 27253 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:18.112589 27262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:18.115943 27262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:18.121887 27262 catalog_manager.cc:1347] Generated new cluster ID: 29dbdab053fa458dbfc66bc5e7d4b01f
I20260812 09:53:18.121991 27262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:18.132150 27262 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:53:18.133671 27262 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:18.145099 27262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7b1dce27242415997f8d67f5652990e: Generated new TSK 0
I20260812 09:53:18.146034 27262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:53:18.166798 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27167
2026-08-12T09:53:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1593 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:53:18 dist-test-slave-2w3w krb5kdc[27277](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:53:18 dist-test-slave-2w3w krb5kdc[27277](info): set up 2 sockets
Aug 12 09:53:18 dist-test-slave-2w3w krb5kdc[27277](info): commencing operation
krb5kdc: starting...
W20260812 09:53:19.308483 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:53:19 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:53:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:53:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:53:19.455729 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:19.579133 27294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:19.579533 27294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:19.579622 27294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:19.584044 27294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:19.584156 27294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:19.584193 27294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:19.584236 27294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:19.584271 27294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:19.590027 27294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:19.591346 27294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:19.592470 27294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:19.601796 27302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:19.601739 27299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:19.601794 27300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:19.602044 27294 server_base.cc:1034] running on GCE node
I20260812 09:53:19.602732 27294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:19.604175 27294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:19.605389 27294 hybrid_clock.cc:648] HybridClock initialized: now 1786528399605366 us; error 45 us; skew 500 ppm
Aug 12 09:53:19 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:19.608657 27294 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:19.609674 27294 webserver.cc:460] Webserver started at http://127.11.118.190:37289/ using document root <none> and password file <none>
I20260812 09:53:19.610320 27294 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:19.610390 27294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:19.610672 27294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:19.613055 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "51ac106a95754d52b20a762b2d4e65ab"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "297073f09f3dda4b0afd79ceccdf2ca6"
server_key_iv: "3ab7e6bdef57430ae421a1ec29c99a65"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.613718 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "51ac106a95754d52b20a762b2d4e65ab"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "297073f09f3dda4b0afd79ceccdf2ca6"
server_key_iv: "3ab7e6bdef57430ae421a1ec29c99a65"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.618057 27294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:53:19.620967 27309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:19.622385 27294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:19.622550 27294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "51ac106a95754d52b20a762b2d4e65ab"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "297073f09f3dda4b0afd79ceccdf2ca6"
server_key_iv: "3ab7e6bdef57430ae421a1ec29c99a65"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.622689 27294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:19.642131 27294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:19.645581 27294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:19.645815 27294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:19.653762 27294 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37129
I20260812 09:53:19.654083 27366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37129 every 8 connection(s)
I20260812 09:53:19.654917 27294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:19.657866 27367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:19.663938 27367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap starting.
I20260812 09:53:19.664657 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27294
I20260812 09:53:19.664824 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:53:19.665118 11738 external_mini_cluster.cc:1428] Setting key 035a59dab517f06120d753e4e6f5068c
I20260812 09:53:19.667047 27367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:19.667868 27367 log.cc:824] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:19.670320 27367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: No bootstrap required, opened a new log
I20260812 09:53:19.674623 27367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
Aug 12 09:53:19 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:19.674947 27367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:19.675043 27367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Initialized, Role: FOLLOWER
I20260812 09:53:19.675606 27367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:19.675779 27367 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:19.675872 27367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:19.675978 27367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:19.677459 27367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:19.677891 27367 leader_election.cc:302] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ac106a95754d52b20a762b2d4e65ab; no voters:
I20260812 09:53:19.678321 27367 leader_election.cc:288] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:53:19.678526 27372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:19.678782 27372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 LEADER]: Becoming Leader. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Running, Role: LEADER
I20260812 09:53:19.679175 27372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:19.679883 27367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:19.680894 27373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:19.681073 27373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:19.681481 27374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ac106a95754d52b20a762b2d4e65ab. Latest consensus state: current_term: 1 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:19.681640 27374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:19.682004 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:19.666585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.11.118.190:37129)
0812 09:53:19.667077 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:19.667095 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:19.667135 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:53:19.667895 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:19.667914 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:19.668310 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:19.668613 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:19.669423 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.670905 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.671862 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.672585 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.672759 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:19.675700 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:19.675707 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:19.675726 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:19.675767 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:19.678088 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:19.678827 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:19.678836 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:19.678845 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:19.679047 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:19.679432 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:19.679436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:19.679438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:19.680015 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:19.680214 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:19.680598 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 09:53:19.680948 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":156,"threads_started":1}
I20260812 09:53:19.682024 27381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:19.685957 27381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:19.693670 27381 catalog_manager.cc:1347] Generated new cluster ID: b4a631e156714431ae63337a64afe34c
I20260812 09:53:19.693833 27381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:19.707078 27381 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:53:19.708130 27381 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:19.717649 27381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Generated new TSK 0
I20260812 09:53:19.718633 27381 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:53:19.755998 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:19.886132 27396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:19.886477 27396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:19.886533 27396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:19.890897 27396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:19.891017 27396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:19.891086 27396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:19.897109 27396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:19.898401 27396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:19.899583 27396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:19.911276 27402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:19.911242 27403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:19.911505 27396 server_base.cc:1034] running on GCE node
W20260812 09:53:19.911274 27405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:19.912112 27396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:19.912809 27396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:19.914000 27396 hybrid_clock.cc:648] HybridClock initialized: now 1786528399913981 us; error 36 us; skew 500 ppm
Aug 12 09:53:19 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:19.917493 27396 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:19.918644 27396 webserver.cc:460] Webserver started at http://127.11.118.129:32987/ using document root <none> and password file <none>
I20260812 09:53:19.919374 27396 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:19.919451 27396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:19.919696 27396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:19.922134 27396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "9e8b01ceb1a64603b061a825f80f8852"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "f5b122b692ba9236e2919aa9c4f26f3b"
server_key_iv: "6503bc913a8d32a3d2ddef21418d474f"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.922791 27396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "9e8b01ceb1a64603b061a825f80f8852"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "f5b122b692ba9236e2919aa9c4f26f3b"
server_key_iv: "6503bc913a8d32a3d2ddef21418d474f"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.927277 27396 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:53:19.930368 27414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:19.932439 27396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:19.932723 27396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "9e8b01ceb1a64603b061a825f80f8852"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "f5b122b692ba9236e2919aa9c4f26f3b"
server_key_iv: "6503bc913a8d32a3d2ddef21418d474f"
server_key_version: "encryptionkey@0"
I20260812 09:53:19.932929 27396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:19.957353 27396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:19.961324 27396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:19.961577 27396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:19.962283 27396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:19.963310 27396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:19.963385 27396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:19.963460 27396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:19.963505 27396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:19.975665 27396 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:40899
I20260812 09:53:19.975814 27547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:40899 every 8 connection(s)
I20260812 09:53:19.977164 27396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:19.986189 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27396
I20260812 09:53:19.986367 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:53:19.986701 11738 external_mini_cluster.cc:1428] Setting key df9b089cb890b81cc8bbb083eed84511
Aug 12 09:53:19 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528399, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:19.999986 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:19.980768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:36823 (local address 127.11.118.190:37129)
0812 09:53:19.980941 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:19.980945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:19.983023 (+ 2078us) server_negotiation.cc:407] Connection header received
0812 09:53:19.984780 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:19.984788 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:19.984869 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:19.984988 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:19.986989 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.987895 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.990117 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.990480 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.990612 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:19.994197 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:19.994205 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:19.994211 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:19.994254 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:19.996496 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:19.997418 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:19.997426 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:19.997431 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:19.997553 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:19.998177 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:19.998184 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:19.998189 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:19.998482 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:19.998578 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:19.999568 (+ 990us) server_negotiation.cc:299] Negotiation successful
0812 09:53:19.999742 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:53:20.001325 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:19.981949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:36823)
0812 09:53:19.982700 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:19.982837 (+ 137us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:19.984498 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:19.985183 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:19.985191 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:19.985658 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:19.986653 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:19.986679 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.988116 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.988120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:19.989927 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:19.989945 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:19.990692 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:19.990698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:19.990961 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:19.991820 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:19.991843 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:19.993922 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:19.996713 (+ 2791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:19.996723 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:19.996766 (+ 43us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:19.997264 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:19.997689 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:19.997692 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:19.997695 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:19.998026 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:19.998684 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:19.998694 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:19.999172 (+ 478us) client_negotiation.cc:769] Sending connection context
0812 09:53:19.999448 (+ 276us) client_negotiation.cc:240] Negotiation successful
0812 09:53:19.999976 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":196,"threads_started":1}
I20260812 09:53:20.003683 27549 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:20.004004 27549 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:20.004853 27549 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:53:20.007510 27327 ts_manager.cc:194] Registered new tserver with Master: 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899)
I20260812 09:53:20.009124 27327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:36823
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:53:20.032284 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:20.158663 27555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:20.159065 27555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:20.159190 27555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:20.163697 27555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:20.163786 27555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:20.163851 27555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:20.169647 27555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:20.170861 27555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:20.171994 27555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:20.182940 27560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:20.182986 27563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:20.183144 27555 server_base.cc:1034] running on GCE node
W20260812 09:53:20.183317 27561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:20.183825 27555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:20.184509 27555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:20.185719 27555 hybrid_clock.cc:648] HybridClock initialized: now 1786528400185690 us; error 43 us; skew 500 ppm
Aug 12 09:53:20 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:20.188870 27555 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:20.189852 27555 webserver.cc:460] Webserver started at http://127.11.118.130:35989/ using document root <none> and password file <none>
I20260812 09:53:20.190486 27555 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:20.190593 27555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:20.190855 27555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:20.193200 27555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "46f7362a50fa4c5ea6d8d213118594b4"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "7c01604ee9b339b23372e33066969a28"
server_key_iv: "6fa31e2c55eba5be60a37334e110aa52"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.193836 27555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "46f7362a50fa4c5ea6d8d213118594b4"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "7c01604ee9b339b23372e33066969a28"
server_key_iv: "6fa31e2c55eba5be60a37334e110aa52"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.198109 27555 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 09:53:20.200980 27571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.202553 27555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:20.202787 27555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "46f7362a50fa4c5ea6d8d213118594b4"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "7c01604ee9b339b23372e33066969a28"
server_key_iv: "6fa31e2c55eba5be60a37334e110aa52"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.202946 27555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:20.217585 27555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:20.221766 27555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:20.222091 27555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:20.222801 27555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:20.223837 27555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:20.223920 27555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.224002 27555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:20.224056 27555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.234478 27555 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39565
I20260812 09:53:20.234503 27703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39565 every 8 connection(s)
I20260812 09:53:20.235606 27555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:20.242633 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27555
I20260812 09:53:20.242798 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:53:20.243184 11738 external_mini_cluster.cc:1428] Setting key 562b4a64c39913981958c91a4cbcb002
Aug 12 09:53:20 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:20.251143 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.237645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:47211 (local address 127.11.118.190:37129)
0812 09:53:20.237796 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.237800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.238841 (+ 1041us) server_negotiation.cc:407] Connection header received
0812 09:53:20.240433 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.240437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.240504 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.240585 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:20.241871 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.242424 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.243977 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.244305 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.244493 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.247157 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:20.247165 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:20.247167 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:20.247193 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:20.248800 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.249397 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.249401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.249402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.249495 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.249865 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.249869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.249871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.250074 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:20.250188 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.250788 (+ 600us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.250936 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 09:53:20.252018 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.237969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:47211)
0812 09:53:20.238626 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.238693 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.240174 (+ 1481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.240769 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.240777 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.241171 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:20.241688 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.241702 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.242571 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.242577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.243846 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.243857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.244543 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.244547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.244737 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.245414 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:20.245431 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:20.246917 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:20.248954 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:20.248961 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:20.248978 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:20.249273 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:20.249595 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:20.249599 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:20.249601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:20.249754 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:20.250187 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:20.250195 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:20.250519 (+ 324us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.250719 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.251111 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":126,"threads_started":1}
I20260812 09:53:20.253309 27704 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:20.253636 27704 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:53:20.254289 27704 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
I20260812 09:53:20.255667 27327 ts_manager.cc:194] Registered new tserver with Master: 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
I20260812 09:53:20.256318 27327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:47211
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:53:20.278610 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:20.398064 27709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:20.398368 27709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:20.398414 27709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:20.402645 27709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:20.402729 27709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:20.402796 27709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:20.408675 27709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:20.409798 27709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:20.410810 27709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:20.421319 27718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:20.421340 27715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:20.421350 27714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:20.421411 27709 server_base.cc:1034] running on GCE node
I20260812 09:53:20.422061 27709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:20.422787 27709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:20.423971 27709 hybrid_clock.cc:648] HybridClock initialized: now 1786528400423951 us; error 35 us; skew 500 ppm
Aug 12 09:53:20 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:20.427641 27709 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:20.428666 27709 webserver.cc:460] Webserver started at http://127.11.118.131:42211/ using document root <none> and password file <none>
I20260812 09:53:20.429288 27709 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:20.429396 27709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:20.429664 27709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:20.431957 27709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "8e65bef9614a428cb80b3cbfe907676c"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "b3cdc68a43cf7ba6121f5be3866c188a"
server_key_iv: "5a2547b3cfa5019b73297803eb9dca35"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.432641 27709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "8e65bef9614a428cb80b3cbfe907676c"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "b3cdc68a43cf7ba6121f5be3866c188a"
server_key_iv: "5a2547b3cfa5019b73297803eb9dca35"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.437105 27709 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:53:20.440214 27725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.441648 27709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:53:20.441864 27709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "8e65bef9614a428cb80b3cbfe907676c"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "b3cdc68a43cf7ba6121f5be3866c188a"
server_key_iv: "5a2547b3cfa5019b73297803eb9dca35"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.442013 27709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:20.462425 27709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:20.466482 27709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:20.466832 27709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:20.467612 27709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:20.468549 27709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:20.468636 27709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.468714 27709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:20.468750 27709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.479336 27709 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:37635
I20260812 09:53:20.479432 27855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:37635 every 8 connection(s)
I20260812 09:53:20.480540 27709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:20.487735 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27709
I20260812 09:53:20.487891 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:53:20.488423 11738 external_mini_cluster.cc:1428] Setting key 99e7eca069e5518c383571c9ac4632a0
Aug 12 09:53:20 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:20.498675 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.482760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:50563 (local address 127.11.118.190:37129)
0812 09:53:20.482938 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.482943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.483846 (+ 903us) server_negotiation.cc:407] Connection header received
0812 09:53:20.485207 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.485210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.485260 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.485344 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:20.487504 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.488264 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.489927 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.490227 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.490316 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.493474 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:20.493478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:20.493480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:20.493509 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:20.495727 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.496522 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.496526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.496528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.496808 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.497240 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.497243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.497245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.497468 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:20.497561 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.498307 (+ 746us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.498493 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:53:20.499408 27858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.483157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:50563)
0812 09:53:20.483682 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.483727 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.484984 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.485769 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.485780 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.486432 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:20.487225 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.487247 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.488468 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.488474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.489754 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.489769 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.490435 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.490441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.490674 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.491548 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:20.491567 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:20.493258 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:20.495974 (+ 2716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:20.495979 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:20.495994 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:20.496333 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:20.496932 (+ 599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:20.496934 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:20.496936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:20.497100 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:20.497585 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:20.497591 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:20.497922 (+ 331us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.498089 (+ 167us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.498390 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":123,"threads_started":1}
I20260812 09:53:20.501010 27856 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:20.501252 27856 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:20.501921 27856 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
I20260812 09:53:20.503615 27326 ts_manager.cc:194] Registered new tserver with Master: 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635)
I20260812 09:53:20.504295 27326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:50563
I20260812 09:53:20.516422 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:53:20.529322 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.518686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43216 (local address 127.11.118.190:37129)
0812 09:53:20.518840 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.518845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.519022 (+ 177us) server_negotiation.cc:407] Connection header received
0812 09:53:20.519238 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.519242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.519291 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.519369 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:20.520367 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.521006 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.522255 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.522526 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.522674 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.524902 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:20.524906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:20.524908 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:20.524944 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:20.527152 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.527792 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.527797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.527798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.527930 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:20.528324 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:20.528327 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:20.528329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:20.528618 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:20.528741 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.529057 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.529185 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:53:20.533278 27326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:53:20.536799 27326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:53:20.553580 27870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.546894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39565 (local address 127.0.0.1:44660)
0812 09:53:20.548285 (+ 1391us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.548300 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.548386 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.549058 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.549061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.549088 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:20.549275 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.549281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550639 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.550643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.552137 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.552144 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.553207 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.553211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.553312 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553332 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.553396 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.553446 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1320,"mutex_wait_us":389,"spinlock_wait_cycles":896,"thread_start_us":157,"threads_started":1}
I20260812 09:53:20.553725 27872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.546820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:40899 (local address 127.0.0.1:34040)
0812 09:53:20.547894 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.547966 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.548097 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.548709 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.548716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.548754 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:20.548895 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.548901 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550330 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.550333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.551991 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.552002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.553239 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.553244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.553349 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553373 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.553446 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.553521 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":887,"mutex_wait_us":282,"thread_start_us":120,"threads_started":1}
I20260812 09:53:20.553580 27871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.547126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37635 (local address 127.0.0.1:49516)
0812 09:53:20.548362 (+ 1236us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.548376 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.548468 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.549058 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.549061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.549093 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:20.549265 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.549274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550350 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.550353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.551794 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.551804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.552971 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.552974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.553084 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553123 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.553248 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.553394 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1176,"mutex_wait_us":328,"spinlock_wait_cycles":8192,"thread_start_us":105,"threads_started":1}
I20260812 09:53:20.554193 27873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.547226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34040 (local address 127.11.118.129:40899)
0812 09:53:20.548096 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.548104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.548130 (+ 26us) server_negotiation.cc:407] Connection header received
0812 09:53:20.548311 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.548319 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.548551 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.548722 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:20.549023 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550179 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.552138 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.552929 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.553040 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553142 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.553668 (+ 526us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.553959 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":86,"threads_started":1}
I20260812 09:53:20.554548 27875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.547671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.11.118.130:39565)
0812 09:53:20.548218 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.548230 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.548482 (+ 252us) server_negotiation.cc:407] Connection header received
0812 09:53:20.548563 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.548567 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.548746 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.548894 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:20.549406 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550488 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.552271 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.552854 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.553008 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553140 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.554280 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.554400 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":170,"threads_started":1}
I20260812 09:53:20.553587 27874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.547661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49516 (local address 127.11.118.131:37635)
0812 09:53:20.548449 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.548463 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.548482 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:53:20.548562 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.548567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.548746 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.548894 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:20.549430 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.550181 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.551926 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.552810 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.552958 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.553121 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.553293 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.553407 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":142,"threads_started":1}
I20260812 09:53:20.557354 27468 tablet_service.cc:1467] Processing CreateTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 (DEFAULT_TABLE table=test-table [id=7967a4fc07df46b691e35668d59d5844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:20.557511 27781 tablet_service.cc:1467] Processing CreateTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 (DEFAULT_TABLE table=test-table [id=7967a4fc07df46b691e35668d59d5844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:20.558410 27468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b7bdf724f048ab81d2fbb33e467772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:20.558542 27781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b7bdf724f048ab81d2fbb33e467772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:20.559950 27627 tablet_service.cc:1467] Processing CreateTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 (DEFAULT_TABLE table=test-table [id=7967a4fc07df46b691e35668d59d5844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:20.561043 27627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b7bdf724f048ab81d2fbb33e467772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:20.565127 27876 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap starting.
I20260812 09:53:20.566996 27877 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Bootstrap starting.
I20260812 09:53:20.567582 27876 tablet_bootstrap.cc:654] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:20.568480 27876 log.cc:824] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:20.569204 27878 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Bootstrap starting.
I20260812 09:53:20.569265 27877 tablet_bootstrap.cc:654] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:20.570642 27877 log.cc:824] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:20.570878 27876 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: No bootstrap required, opened a new log
I20260812 09:53:20.571147 27876 ts_tablet_manager.cc:1397] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:53:20.572089 27878 tablet_bootstrap.cc:654] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:20.572980 27877 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: No bootstrap required, opened a new log
I20260812 09:53:20.572968 27878 log.cc:824] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:20.573182 27877 ts_tablet_manager.cc:1397] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:53:20.575290 27878 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: No bootstrap required, opened a new log
I20260812 09:53:20.575491 27878 ts_tablet_manager.cc:1397] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:53:20.576009 27876 raft_consensus.cc:348] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.576295 27876 raft_consensus.cc:374] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:20.576351 27876 raft_consensus.cc:729] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8b01ceb1a64603b061a825f80f8852, State: Initialized, Role: FOLLOWER
I20260812 09:53:20.576828 27876 consensus_queue.cc:260] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.577188 27877 raft_consensus.cc:348] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.577471 27877 raft_consensus.cc:374] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:20.577527 27877 raft_consensus.cc:729] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e65bef9614a428cb80b3cbfe907676c, State: Initialized, Role: FOLLOWER
I20260812 09:53:20.577642 27549 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
I20260812 09:53:20.577977 27876 ts_tablet_manager.cc:1428] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260812 09:53:20.578004 27877 consensus_queue.cc:260] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.579062 27877 ts_tablet_manager.cc:1428] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 09:53:20.579430 27856 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
I20260812 09:53:20.579560 27878 raft_consensus.cc:348] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.579845 27878 raft_consensus.cc:374] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:20.579909 27878 raft_consensus.cc:729] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f7362a50fa4c5ea6d8d213118594b4, State: Initialized, Role: FOLLOWER
I20260812 09:53:20.580308 27878 consensus_queue.cc:260] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.581072 27704 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
I20260812 09:53:20.581355 27878 ts_tablet_manager.cc:1428] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:53:20.672132 27886 raft_consensus.cc:482] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:20.672387 27886 raft_consensus.cc:504] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.673652 27886 leader_election.cc:288] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899), 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635)
I20260812 09:53:20.678043 27874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.674146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:39573 (local address 127.11.118.131:37635)
0812 09:53:20.674304 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.674308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.674325 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:53:20.674383 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.674385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.674426 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.674505 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:20.675027 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.675737 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677020 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.677434 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677572 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.677625 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.677840 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.677914 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 09:53:20.678043 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.674015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37635 (local address 127.11.118.130:39573)
0812 09:53:20.674149 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.674166 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.674275 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.674552 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.674556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.674579 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:20.674824 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.674833 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.675868 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.675872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.676883 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.676893 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.677565 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.677703 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.677723 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.677817 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.677897 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 09:53:20.678349 27873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.674133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:35603 (local address 127.11.118.129:40899)
0812 09:53:20.674262 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.674267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.674800 (+ 533us) server_negotiation.cc:407] Connection header received
0812 09:53:20.675039 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.675043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.675109 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.675201 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:20.675557 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.676217 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677334 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.677765 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677914 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.677964 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.678153 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.678234 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:53:20.678341 27887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.674015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:40899 (local address 127.11.118.130:35603)
0812 09:53:20.674556 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.674569 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:20.674807 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:20.675259 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:20.675262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:20.675280 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:20.675409 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.675414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.676378 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.676381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.677203 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:20.677212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.677912 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.677916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:20.678016 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.678041 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 09:53:20.678124 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 09:53:20.678196 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":151,"thread_start_us":150,"threads_started":1}
I20260812 09:53:20.678825 27803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b7bdf724f048ab81d2fbb33e467772" candidate_uuid: "46f7362a50fa4c5ea6d8d213118594b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e65bef9614a428cb80b3cbfe907676c" is_pre_election: true
I20260812 09:53:20.678928 27492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b7bdf724f048ab81d2fbb33e467772" candidate_uuid: "46f7362a50fa4c5ea6d8d213118594b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8b01ceb1a64603b061a825f80f8852" is_pre_election: true
I20260812 09:53:20.679219 27803 raft_consensus.cc:2454] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f7362a50fa4c5ea6d8d213118594b4 in term 0.
I20260812 09:53:20.679246 27492 raft_consensus.cc:2454] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46f7362a50fa4c5ea6d8d213118594b4 in term 0.
I20260812 09:53:20.679764 27575 leader_election.cc:302] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c, 9e8b01ceb1a64603b061a825f80f8852; no voters:
I20260812 09:53:20.680121 27886 raft_consensus.cc:2781] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:20.680214 27886 raft_consensus.cc:482] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:20.680259 27886 raft_consensus.cc:3037] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:20.681449 27886 raft_consensus.cc:504] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.681890 27886 leader_election.cc:288] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899), 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635)
I20260812 09:53:20.682300 27803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b7bdf724f048ab81d2fbb33e467772" candidate_uuid: "46f7362a50fa4c5ea6d8d213118594b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e65bef9614a428cb80b3cbfe907676c"
I20260812 09:53:20.682341 27492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b7bdf724f048ab81d2fbb33e467772" candidate_uuid: "46f7362a50fa4c5ea6d8d213118594b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8b01ceb1a64603b061a825f80f8852"
I20260812 09:53:20.682456 27492 raft_consensus.cc:3037] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:20.682451 27803 raft_consensus.cc:3037] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:20.684069 27492 raft_consensus.cc:2454] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f7362a50fa4c5ea6d8d213118594b4 in term 1.
I20260812 09:53:20.684068 27803 raft_consensus.cc:2454] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46f7362a50fa4c5ea6d8d213118594b4 in term 1.
I20260812 09:53:20.684463 27574 leader_election.cc:302] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f7362a50fa4c5ea6d8d213118594b4, 9e8b01ceb1a64603b061a825f80f8852; no voters:
I20260812 09:53:20.684702 27886 raft_consensus.cc:2781] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:20.685029 27886 raft_consensus.cc:686] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 LEADER]: Becoming Leader. State: Replica: 46f7362a50fa4c5ea6d8d213118594b4, State: Running, Role: LEADER
I20260812 09:53:20.685390 27886 consensus_queue.cc:237] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:20.688937 27327 catalog_manager.cc:5495] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "46f7362a50fa4c5ea6d8d213118594b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } health_report { overall_health: UNKNOWN } } }
I20260812 09:53:20.715579 27875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.711676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44664 (local address 127.11.118.130:39565)
0812 09:53:20.711827 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:20.711832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:20.711856 (+ 24us) server_negotiation.cc:407] Connection header received
0812 09:53:20.711981 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:20.711985 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:20.712050 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:20.712169 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:53:20.712412 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.712939 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.713827 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:20.714070 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:20.714285 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:20.714639 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:53:20.715126 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:53:20.715267 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:20.715334 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 09:53:20.715396 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:53:20.722080 27492 raft_consensus.cc:1261] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Refusing update from remote peer 46f7362a50fa4c5ea6d8d213118594b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:20.722080 27803 raft_consensus.cc:1261] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Refusing update from remote peer 46f7362a50fa4c5ea6d8d213118594b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:20.723034 27886 consensus_queue.cc:1035] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:20.723278 27888 consensus_queue.cc:1035] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:53:20.730273 27551 tablet.cc:2369] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:53:20.731662 27857 tablet.cc:2369] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:20.733042 27892 mvcc.cc:205] Tried to move back new op lower bound from 7317620329348653056 to 7317620329210523648. Current Snapshot: MvccSnapshot[applied={T|T < 7317620329348653056}]
I20260812 09:53:20.733237 27893 mvcc.cc:205] Tried to move back new op lower bound from 7317620329348653056 to 7317620329210523648. Current Snapshot: MvccSnapshot[applied={T|T < 7317620329348653056}]
I20260812 09:53:20.743752 27327 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:20.743942 27327 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:20.747587 27327 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Sending DeleteTablet for 3 replicas of tablet 71b7bdf724f048ab81d2fbb33e467772
I20260812 09:53:20.749047 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27396
I20260812 09:53:20.749090 27468 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:20 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:34040
I20260812 09:53:20.749115 27781 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:20 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:49516
I20260812 09:53:20.750785 27627 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:20 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:44660
I20260812 09:53:20.752100 27908 tablet_replica.cc:330] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: stopping tablet replica
I20260812 09:53:20.752530 27908 raft_consensus.cc:2229] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:53:20.753029 27908 raft_consensus.cc:2258] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:20.754295 27907 tablet_replica.cc:330] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: stopping tablet replica
I20260812 09:53:20.755496 27907 raft_consensus.cc:2229] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:20.755877 27907 raft_consensus.cc:2258] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:20.756356 27908 ts_tablet_manager.cc:1905] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:20.757434 27907 ts_tablet_manager.cc:1905] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:20.760232 27907 ts_tablet_manager.cc:1918] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:20.760355 27907 log.cc:1196] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/71b7bdf724f048ab81d2fbb33e467772
I20260812 09:53:20.760245 27908 ts_tablet_manager.cc:1918] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:20.760569 27908 log.cc:1196] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/71b7bdf724f048ab81d2fbb33e467772
I20260812 09:53:20.760707 27907 ts_tablet_manager.cc:1939] T 71b7bdf724f048ab81d2fbb33e467772 P 8e65bef9614a428cb80b3cbfe907676c: Deleting consensus metadata
I20260812 09:53:20.761026 27908 ts_tablet_manager.cc:1939] T 71b7bdf724f048ab81d2fbb33e467772 P 46f7362a50fa4c5ea6d8d213118594b4: Deleting consensus metadata
I20260812 09:53:20.762409 27314 catalog_manager.cc:4841] TS 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): tablet 71b7bdf724f048ab81d2fbb33e467772 (table test-table [id=7967a4fc07df46b691e35668d59d5844]) successfully deleted
W20260812 09:53:20.762537 27312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:40899 (error 108)
I20260812 09:53:20.762684 27313 catalog_manager.cc:4841] TS 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): tablet 71b7bdf724f048ab81d2fbb33e467772 (table test-table [id=7967a4fc07df46b691e35668d59d5844]) successfully deleted
I20260812 09:53:20.762779 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27555
I20260812 09:53:20.768126 27870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:20.767720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:40899 (local address 127.0.0.1:34050)
0812 09:53:20.767913 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:20.768004 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:40899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 09:53:20.768401 27312 catalog_manager.cc:4584] TS 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 71b7bdf724f048ab81d2fbb33e467772: Network error: Client connection negotiation failed: client connection to 127.11.118.129:40899: connect: Connection refused (error 111)
I20260812 09:53:20.772811 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27709
I20260812 09:53:20.781850 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27294
I20260812 09:53:20.791832 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--webserver_interface=127.11.118.190
--webserver_port=37289
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:20.913820 27910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:20.914228 27910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:20.914305 27910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:20.918932 27910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:20.919059 27910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:20.919098 27910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:20.919139 27910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:20.919174 27910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:20.924978 27910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=37289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:20.926220 27910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:20.927364 27910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:20.942867 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:20.942895 27918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:20.942867 27917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:20.943253 27910 server_base.cc:1034] running on GCE node
I20260812 09:53:20.944062 27910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:20.945437 27910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:20.946663 27910 hybrid_clock.cc:648] HybridClock initialized: now 1786528400946634 us; error 58 us; skew 500 ppm
Aug 12 09:53:20 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:20.950096 27910 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:20.951218 27910 webserver.cc:460] Webserver started at http://127.11.118.190:37289/ using document root <none> and password file <none>
I20260812 09:53:20.951869 27910 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:20.952008 27910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:20.956346 27910 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:53:20.958768 27930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:20.960286 27910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:20.960464 27910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "51ac106a95754d52b20a762b2d4e65ab"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "297073f09f3dda4b0afd79ceccdf2ca6"
server_key_iv: "3ab7e6bdef57430ae421a1ec29c99a65"
server_key_version: "encryptionkey@0"
I20260812 09:53:20.961130 27910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:20.983992 27910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:20.988492 27910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:20.988833 27910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:20.998055 27910 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37129
I20260812 09:53:20.998430 27992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37129 every 8 connection(s)
I20260812 09:53:20.999509 27910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:21.000686 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27910
I20260812 09:53:21.002393 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:40899
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=32987
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:21.005672 27993 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:53:21.007769 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap starting.
I20260812 09:53:21.027595 27993 log.cc:824] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:21.037515 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:53:21.038002 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap complete.
I20260812 09:53:21.042387 27993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:21.042889 27993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Initialized, Role: FOLLOWER
I20260812 09:53:21.043488 27993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:21.043617 27993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:21.043713 27993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:21.043838 27993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:53:21.047333 27993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:21.047880 27993 leader_election.cc:302] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ac106a95754d52b20a762b2d4e65ab; no voters:
I20260812 09:53:21.048336 27993 leader_election.cc:288] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 09:53:21.048524 27997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Leader election won for term 2
I20260812 09:53:21.048858 27997 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 LEADER]: Becoming Leader. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Running, Role: LEADER
I20260812 09:53:21.049306 27997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:21.050450 27997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ac106a95754d52b20a762b2d4e65ab. Latest consensus state: current_term: 2 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:21.050611 27997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:21.051226 27999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:21.051352 27999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:21.051432 27993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:21.053426 28002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:21.058904 28002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:21.059682 28002 catalog_manager.cc:1259] Loaded cluster ID: b4a631e156714431ae63337a64afe34c
I20260812 09:53:21.059749 28002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:21.060950 28002 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 09:53:21.063930 28002 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 09:53:21.069119 28002 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:21.069936 28002 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Loaded TSK: 0
I20260812 09:53:21.071048 28002 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:53:21.149195 27995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:21.149520 27995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:21.149567 27995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:21.154336 27995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:21.154428 27995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:21.154524 27995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:21.160497 27995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:40899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=32987
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:21.161742 27995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:21.163398 27995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:21.175390 28028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.175390 28024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.175390 28025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:21.176242 27995 server_base.cc:1034] running on GCE node
I20260812 09:53:21.176719 27995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:21.177524 27995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:21.178721 27995 hybrid_clock.cc:648] HybridClock initialized: now 1786528401178693 us; error 45 us; skew 500 ppm
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:21.182384 27995 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:21.183706 27995 webserver.cc:460] Webserver started at http://127.11.118.129:32987/ using document root <none> and password file <none>
I20260812 09:53:21.184355 27995 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:21.184443 27995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:21.188942 27995 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:53:21.191475 28036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.193341 27995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:21.193486 27995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "9e8b01ceb1a64603b061a825f80f8852"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "f5b122b692ba9236e2919aa9c4f26f3b"
server_key_iv: "6503bc913a8d32a3d2ddef21418d474f"
server_key_version: "encryptionkey@0"
I20260812 09:53:21.194221 27995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:21.207320 27995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:21.211170 27995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:21.211401 27995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:21.212152 27995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:21.213440 28043 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 09:53:21.218309 27995 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 09:53:21.218398 27995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 09:53:21.218456 27995 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 09:53:21.220512 27995 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 09:53:21.220602 27995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260812 09:53:21.220896 28043 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap starting.
I20260812 09:53:21.233562 27995 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:40899
I20260812 09:53:21.233788 28165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:40899 every 8 connection(s)
I20260812 09:53:21.235088 27995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:21.241813 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 27995
I20260812 09:53:21.242586 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:39565
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=35989
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:21.245409 28043 log.cc:824] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:21.255553 28170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.237398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:47097)
0812 09:53:21.238243 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.238303 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.239229 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.240737 (+ 1508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.240745 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.241317 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:21.242004 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.242030 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.243882 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.243886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.245130 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.245150 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.246329 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.246333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.246501 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.247315 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:21.247333 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:21.249141 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:21.251803 (+ 2662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.251809 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.251824 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.252279 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.252739 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.252745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.252747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.252987 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.253614 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:21.253620 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:21.253886 (+ 266us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.254107 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.254509 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":140,"threads_started":1}
I20260812 09:53:21.255538 28169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.237426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47097 (local address 127.11.118.190:37129)
0812 09:53:21.238064 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.238086 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.238473 (+ 387us) server_negotiation.cc:407] Connection header received
0812 09:53:21.239714 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.239730 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.240192 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.240667 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:21.242431 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.243665 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.245331 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.246120 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.246325 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.249423 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:21.249429 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:21.249443 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:21.249480 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:21.251640 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.252430 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.252436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.252440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.252631 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.253079 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.253083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.253084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.253488 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:21.253640 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.254246 (+ 606us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.254527 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":161,"threads_started":1}
I20260812 09:53:21.256824 28043 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:53:21.257511 28043 tablet_bootstrap.cc:492] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap complete.
I20260812 09:53:21.259058 28166 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:21.259373 28166 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:21.259397 28043 ts_tablet_manager.cc:1397] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Time spent bootstrapping tablet: real 0.039s user 0.022s sys 0.016s
I20260812 09:53:21.259980 28166 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
I20260812 09:53:21.262670 27950 ts_manager.cc:194] Registered new tserver with Master: 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899)
I20260812 09:53:21.262637 28043 raft_consensus.cc:348] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:21.263279 28043 raft_consensus.cc:729] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8b01ceb1a64603b061a825f80f8852, State: Initialized, Role: FOLLOWER
I20260812 09:53:21.263813 28043 consensus_queue.cc:260] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } }
I20260812 09:53:21.264966 28043 ts_tablet_manager.cc:1428] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 09:53:21.266871 27950 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:47097
I20260812 09:53:21.269655 28166 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:53:21.278622 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.266223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:40899 (local address 127.0.0.1:34058)
0812 09:53:21.266700 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.266772 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.266926 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.267944 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.267951 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.268429 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:21.268583 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.268595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.269944 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.269948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.271055 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.271069 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.271834 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.271837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.271959 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.272644 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:21.272659 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:21.274319 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:21.276785 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.276796 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.276801 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.277093 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.277420 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.277422 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.277423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.277507 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.278055 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:21.278060 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:21.278172 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.278297 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.278479 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":130,"threads_started":1}
I20260812 09:53:21.278748 28176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.266314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34058 (local address 127.11.118.129:40899)
0812 09:53:21.267279 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.267297 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.267324 (+ 27us) server_negotiation.cc:407] Connection header received
0812 09:53:21.267402 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.267406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.267614 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.267787 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:21.268747 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.269806 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.271195 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.271716 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.271814 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.274489 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:21.274502 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:21.274515 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:21.274546 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:21.276639 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.277217 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.277223 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.277225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.277324 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.277596 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.277599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.277600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.277941 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:21.278071 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.278404 (+ 333us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.278584 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":128,"threads_started":1}
I20260812 09:53:21.279917 28092 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b7bdf724f048ab81d2fbb33e467772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:20 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:34058
I20260812 09:53:21.280864 28177 tablet_replica.cc:330] stopping tablet replica
I20260812 09:53:21.281211 28177 raft_consensus.cc:2229] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:21.281479 28177 raft_consensus.cc:2258] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:21.282589 28177 ts_tablet_manager.cc:1905] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:21.287508 28177 ts_tablet_manager.cc:1918] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:21.287653 28177 log.cc:1196] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/71b7bdf724f048ab81d2fbb33e467772
I20260812 09:53:21.287969 28177 ts_tablet_manager.cc:1939] T 71b7bdf724f048ab81d2fbb33e467772 P 9e8b01ceb1a64603b061a825f80f8852: Deleting consensus metadata
I20260812 09:53:21.290184 27932 catalog_manager.cc:4841] TS 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899): tablet 71b7bdf724f048ab81d2fbb33e467772 (table test-table [id=7967a4fc07df46b691e35668d59d5844]) successfully deleted
W20260812 09:53:21.380189 28171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:21.380564 28171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:21.380647 28171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:21.384956 28171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:21.385054 28171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:21.385149 28171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:21.390677 28171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:39565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=35989
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:21.391896 28171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:21.392954 28171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:21.403148 28187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.403352 28185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.403543 28184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:21.403534 28171 server_base.cc:1034] running on GCE node
I20260812 09:53:21.404155 28171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:21.404812 28171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:21.405990 28171 hybrid_clock.cc:648] HybridClock initialized: now 1786528401405969 us; error 33 us; skew 500 ppm
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:21.409252 28171 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:21.410259 28171 webserver.cc:460] Webserver started at http://127.11.118.130:35989/ using document root <none> and password file <none>
I20260812 09:53:21.410811 28171 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:21.410900 28171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:21.415272 28171 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:53:21.418007 28196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.419610 28171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:21.419785 28171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "46f7362a50fa4c5ea6d8d213118594b4"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "7c01604ee9b339b23372e33066969a28"
server_key_iv: "6fa31e2c55eba5be60a37334e110aa52"
server_key_version: "encryptionkey@0"
I20260812 09:53:21.420413 28171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:21.444948 28171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:21.448559 28171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:21.448778 28171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:21.449447 28171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:21.450330 28171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:21.450390 28171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.450431 28171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:21.450489 28171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.461539 28171 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39565
I20260812 09:53:21.461581 28323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39565 every 8 connection(s)
I20260812 09:53:21.462678 28171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:21.463333 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28171
I20260812 09:53:21.463842 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:37635
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=42211
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:21.482473 28169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.464966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:60979 (local address 127.11.118.190:37129)
0812 09:53:21.465139 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.465143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.466409 (+ 1266us) server_negotiation.cc:407] Connection header received
0812 09:53:21.468576 (+ 2167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.468580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.468635 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.468722 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:21.470757 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.471439 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.473592 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.473984 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.474123 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.478051 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:21.478061 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:21.478063 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:21.478100 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:21.479776 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.480546 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.480549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.480551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.480650 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.481103 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.481106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.481107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.481328 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:21.481426 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.482183 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.482316 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 09:53:21.483525 28327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.465472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:60979)
0812 09:53:21.466163 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.466235 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.468266 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.468970 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.468982 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.469646 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:21.470510 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.470536 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.471599 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.471605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.473322 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.473340 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.474209 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.474216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.474520 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.475516 (+ 996us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:21.475545 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:21.477763 (+ 2218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:21.479966 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.479973 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.479994 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.480403 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.480753 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.480756 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.480758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.480955 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.481452 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:21.481459 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:21.481815 (+ 356us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.482037 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.482423 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":162,"threads_started":1}
I20260812 09:53:21.484964 28324 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:21.485265 28324 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:21.485854 28324 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
I20260812 09:53:21.487200 27950 ts_manager.cc:194] Registered new tserver with Master: 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
I20260812 09:53:21.487803 27950 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:60979
W20260812 09:53:21.592486 28326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:21.592856 28326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:21.592912 28326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:21.597327 28326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:21.597409 28326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:21.597508 28326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:21.603531 28326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:37635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=42211
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:21.604889 28326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:21.606036 28326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:21.617087 28333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.617115 28332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:21.617117 28336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:21.617341 28326 server_base.cc:1034] running on GCE node
I20260812 09:53:21.617787 28326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:21.618556 28326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:21.619755 28326 hybrid_clock.cc:648] HybridClock initialized: now 1786528401619743 us; error 31 us; skew 500 ppm
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:21.622799 28326 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:21.623819 28326 webserver.cc:460] Webserver started at http://127.11.118.131:42211/ using document root <none> and password file <none>
I20260812 09:53:21.624465 28326 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:21.624548 28326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:21.628789 28326 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260812 09:53:21.631227 28344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.632705 28326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:21.632825 28326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "8e65bef9614a428cb80b3cbfe907676c"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "b3cdc68a43cf7ba6121f5be3866c188a"
server_key_iv: "5a2547b3cfa5019b73297803eb9dca35"
server_key_version: "encryptionkey@0"
I20260812 09:53:21.633430 28326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:21.647119 28326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:21.650569 28326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:21.650738 28326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:21.651422 28326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:21.652328 28326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:21.652381 28326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.652423 28326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:21.652439 28326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:21.663686 28326 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:37635
I20260812 09:53:21.663733 28476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:37635 every 8 connection(s)
I20260812 09:53:21.664868 28326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:21.674022 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28326
Aug 12 09:53:21 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:21.680338 28169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.667020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:48353 (local address 127.11.118.190:37129)
0812 09:53:21.667179 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.667182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.668026 (+ 844us) server_negotiation.cc:407] Connection header received
0812 09:53:21.669415 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.669418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.669472 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.669555 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:21.670847 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.671480 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.672721 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.672966 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.673072 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.676275 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:21.676279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:21.676281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:21.676307 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:21.677921 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.678539 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.678542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.678544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.678634 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.679076 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.679082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.679086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.679334 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:21.679463 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.680012 (+ 549us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.680136 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:53:21.681250 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.667392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:48353)
0812 09:53:21.667865 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.667908 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.669182 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.669742 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.669749 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.670126 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:21.670643 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.670666 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.671626 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.671630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.672582 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.672593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.673178 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.673182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.673367 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.674062 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:21.674089 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:21.676061 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:21.678094 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.678102 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.678122 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.678422 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.678734 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:21.678740 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:21.678743 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:21.678905 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:21.679463 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:21.679472 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:21.679755 (+ 283us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.679953 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.680337 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":107,"threads_started":1}
I20260812 09:53:21.682631 28477 heartbeater.cc:347] Connected to a master server at 127.11.118.190:37129
I20260812 09:53:21.682986 28477 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:21.683791 28477 heartbeater.cc:511] Master 127.11.118.190:37129 requested a full tablet report, sending...
I20260812 09:53:21.684116 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.674929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43232 (local address 127.11.118.190:37129)
0812 09:53:21.675224 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.675228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.675292 (+ 64us) server_negotiation.cc:407] Connection header received
0812 09:53:21.675484 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.675487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.675534 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.675617 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:21.676944 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.677487 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.678359 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.678616 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.678729 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.680113 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:21.680116 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:21.680119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:21.680144 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:21.681928 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.682443 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.682447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.682448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.682539 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:21.682933 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:21.682937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:21.682938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:21.683308 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:21.683537 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.683729 (+ 192us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.683935 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":84,"threads_started":1}
I20260812 09:53:21.684964 27950 ts_manager.cc:194] Registered new tserver with Master: 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635)
I20260812 09:53:21.685550 27950 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:48353
I20260812 09:53:21.686084 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:53:21.690743 28481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.686727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43246 (local address 127.11.118.190:37129)
0812 09:53:21.686909 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.686913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.687096 (+ 183us) server_negotiation.cc:407] Connection header received
0812 09:53:21.687289 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.687292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.687413 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.687525 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:53:21.687785 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.688324 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.689194 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.689445 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.689564 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.689908 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:53:21.690311 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:53:21.690446 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.690520 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.690588 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:53:21.691646 27950 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43246:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:53:21.695859 27950 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:53:21.705400 28092 tablet_service.cc:1467] Processing CreateTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf (DEFAULT_TABLE table=test-table [id=2ff540f94e874e069ea622784e64fb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:21.706148 28092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523fe7c9fc9841dd821e65edb362a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:21.709590 28043 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap starting.
I20260812 09:53:21.710683 28043 tablet_bootstrap.cc:654] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:21.710724 28174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.704368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37635 (local address 127.0.0.1:49522)
0812 09:53:21.704548 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.704566 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.704652 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.705916 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.705919 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.705939 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:21.706057 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.706064 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.707609 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.707613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.708882 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.708895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.710182 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.710185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.710294 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.710402 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.710460 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.710566 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":4}
I20260812 09:53:21.710764 28487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.704535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39565 (local address 127.0.0.1:44680)
0812 09:53:21.704898 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.704912 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.705001 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.706283 (+ 1282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.706285 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.706306 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:21.706397 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.706403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.707911 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.707917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.708761 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.708772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.710409 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.710413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.710505 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.710523 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.710594 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.710657 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":28,"thread_start_us":137,"threads_started":1}
I20260812 09:53:21.711459 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.704595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49522 (local address 127.11.118.131:37635)
0812 09:53:21.705450 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.705461 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.705479 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:53:21.705544 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.705548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.705720 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.705900 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:21.706194 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.707446 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.709031 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.710022 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.711107 (+ 1085us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.711218 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.711262 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.711346 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":203,"threads_started":1}
I20260812 09:53:21.711460 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.705017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44680 (local address 127.11.118.130:39565)
0812 09:53:21.705331 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.705353 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.705380 (+ 27us) server_negotiation.cc:407] Connection header received
0812 09:53:21.705470 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.705476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.705721 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.705900 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:21.706550 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.707764 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.708914 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.710022 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.710177 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.710339 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.710674 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.711284 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":120,"threads_started":1}
I20260812 09:53:21.712981 28043 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: No bootstrap required, opened a new log
I20260812 09:53:21.713081 28043 ts_tablet_manager.cc:1397] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260812 09:53:21.713562 28043 raft_consensus.cc:348] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.713686 28043 raft_consensus.cc:374] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:21.713724 28043 raft_consensus.cc:729] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8b01ceb1a64603b061a825f80f8852, State: Initialized, Role: FOLLOWER
I20260812 09:53:21.713883 28043 consensus_queue.cc:260] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.714824 28043 ts_tablet_manager.cc:1428] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 09:53:21.714790 28403 tablet_service.cc:1467] Processing CreateTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf (DEFAULT_TABLE table=test-table [id=2ff540f94e874e069ea622784e64fb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:21.714766 28252 tablet_service.cc:1467] Processing CreateTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf (DEFAULT_TABLE table=test-table [id=2ff540f94e874e069ea622784e64fb2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:21.715953 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523fe7c9fc9841dd821e65edb362a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:21.715957 28252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 523fe7c9fc9841dd821e65edb362a6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:21.723804 28491 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Bootstrap starting.
I20260812 09:53:21.724723 28492 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Bootstrap starting.
I20260812 09:53:21.726785 28491 tablet_bootstrap.cc:654] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:21.727201 28492 tablet_bootstrap.cc:654] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:21.727692 28491 log.cc:824] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:21.727942 28492 log.cc:824] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:21.729944 28491 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: No bootstrap required, opened a new log
I20260812 09:53:21.730065 28492 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: No bootstrap required, opened a new log
I20260812 09:53:21.730202 28491 ts_tablet_manager.cc:1397] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 09:53:21.730280 28492 ts_tablet_manager.cc:1397] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 09:53:21.733196 28492 raft_consensus.cc:348] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.733423 28492 raft_consensus.cc:374] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:21.733457 28492 raft_consensus.cc:729] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e65bef9614a428cb80b3cbfe907676c, State: Initialized, Role: FOLLOWER
I20260812 09:53:21.733274 28491 raft_consensus.cc:348] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.733568 28491 raft_consensus.cc:374] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:21.733660 28491 raft_consensus.cc:729] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f7362a50fa4c5ea6d8d213118594b4, State: Initialized, Role: FOLLOWER
I20260812 09:53:21.734000 28492 consensus_queue.cc:260] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.734117 28491 consensus_queue.cc:260] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.734738 28477 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
I20260812 09:53:21.734827 28324 heartbeater.cc:503] Master 127.11.118.190:37129 was elected leader, sending a full tablet report...
I20260812 09:53:21.735149 28492 ts_tablet_manager.cc:1428] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260812 09:53:21.735172 28491 ts_tablet_manager.cc:1428] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260812 09:53:21.736462 28167 tablet.cc:2369] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:21.910050 28173 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:21.910328 28173 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.911671 28173 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
W20260812 09:53:21.915953 28478 tablet.cc:2369] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:21.917514 28488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.912166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:39027 (local address 127.11.118.131:37635)
0812 09:53:21.912314 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.912319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.912479 (+ 160us) server_negotiation.cc:407] Connection header received
0812 09:53:21.912692 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.912697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.912755 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.912836 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:21.913177 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.914002 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.916196 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.916866 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.916988 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.917044 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.917258 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.917372 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:53:21.917519 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.912024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37635 (local address 127.11.118.129:39027)
0812 09:53:21.912358 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.912376 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.912553 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.912890 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.912892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.912906 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:21.913052 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.913059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.914190 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.914194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.916022 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.916037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.916982 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.916985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.917092 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.917138 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.917219 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.917295 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":187,"thread_start_us":108,"threads_started":1}
I20260812 09:53:21.917652 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.912171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:46037 (local address 127.11.118.130:39565)
0812 09:53:21.912360 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.912366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.912723 (+ 357us) server_negotiation.cc:407] Connection header received
0812 09:53:21.912888 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.912892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.912952 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.913029 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:21.913301 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.914028 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.916196 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.916866 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.917010 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.917055 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.917448 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.917531 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 09:53:21.918231 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.912024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39565 (local address 127.11.118.129:46037)
0812 09:53:21.912640 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:21.912653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:21.912746 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:21.913067 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:21.913070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:21.913087 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:21.913187 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.913192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.914190 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.914194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.916021 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:21.916037 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.917183 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.917185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:21.917303 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.917324 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 09:53:21.917927 (+ 603us) client_negotiation.cc:240] Negotiation successful
0812 09:53:21.918017 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":485,"thread_start_us":94,"threads_started":1}
I20260812 09:53:21.918380 28427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "523fe7c9fc9841dd821e65edb362a6bf" candidate_uuid: "9e8b01ceb1a64603b061a825f80f8852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e65bef9614a428cb80b3cbfe907676c" is_pre_election: true
I20260812 09:53:21.918823 28427 raft_consensus.cc:2454] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8b01ceb1a64603b061a825f80f8852 in term 0.
I20260812 09:53:21.918917 28273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "523fe7c9fc9841dd821e65edb362a6bf" candidate_uuid: "9e8b01ceb1a64603b061a825f80f8852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f7362a50fa4c5ea6d8d213118594b4" is_pre_election: true
I20260812 09:53:21.919277 28273 raft_consensus.cc:2454] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8b01ceb1a64603b061a825f80f8852 in term 0.
I20260812 09:53:21.919418 28039 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e65bef9614a428cb80b3cbfe907676c, 9e8b01ceb1a64603b061a825f80f8852; no voters:
I20260812 09:53:21.919811 28173 raft_consensus.cc:2781] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:21.919914 28173 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:21.919963 28173 raft_consensus.cc:3037] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:21.921062 28173 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.921460 28173 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 1 election: Requested vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
I20260812 09:53:21.921993 28427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "523fe7c9fc9841dd821e65edb362a6bf" candidate_uuid: "9e8b01ceb1a64603b061a825f80f8852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e65bef9614a428cb80b3cbfe907676c"
I20260812 09:53:21.922134 28427 raft_consensus.cc:3037] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:21.922363 28273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "523fe7c9fc9841dd821e65edb362a6bf" candidate_uuid: "9e8b01ceb1a64603b061a825f80f8852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f7362a50fa4c5ea6d8d213118594b4"
I20260812 09:53:21.922537 28273 raft_consensus.cc:3037] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:21.923599 28427 raft_consensus.cc:2454] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8b01ceb1a64603b061a825f80f8852 in term 1.
I20260812 09:53:21.923921 28273 raft_consensus.cc:2454] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8b01ceb1a64603b061a825f80f8852 in term 1.
I20260812 09:53:21.923976 28039 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e65bef9614a428cb80b3cbfe907676c, 9e8b01ceb1a64603b061a825f80f8852; no voters:
I20260812 09:53:21.924230 28173 raft_consensus.cc:2781] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:21.924506 28173 raft_consensus.cc:686] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8b01ceb1a64603b061a825f80f8852, State: Running, Role: LEADER
I20260812 09:53:21.924890 28173 consensus_queue.cc:237] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:21.928293 27949 catalog_manager.cc:5495] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "9e8b01ceb1a64603b061a825f80f8852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } health_report { overall_health: HEALTHY } } }
I20260812 09:53:21.957432 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:21.952126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34068 (local address 127.11.118.129:40899)
0812 09:53:21.952691 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:21.952723 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:21.952799 (+ 76us) server_negotiation.cc:407] Connection header received
0812 09:53:21.952894 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:21.952896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:21.952964 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:21.953144 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:53:21.953799 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.954403 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.955503 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:21.955740 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:21.955834 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:21.956372 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:53:21.956857 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:53:21.957006 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:21.957191 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 09:53:21.957259 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":227,"threads_started":1}
I20260812 09:53:21.962282 28427 raft_consensus.cc:1261] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Refusing update from remote peer 9e8b01ceb1a64603b061a825f80f8852: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:21.962282 28273 raft_consensus.cc:1261] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Refusing update from remote peer 9e8b01ceb1a64603b061a825f80f8852: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:21.963217 28173 consensus_queue.cc:1035] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:21.963479 28502 consensus_queue.cc:1035] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:53:21.964238 28325 tablet.cc:2369] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:21.974551 28507 mvcc.cc:205] Tried to move back new op lower bound from 7317620334428979200 to 7317620334287421440. Current Snapshot: MvccSnapshot[applied={T|T < 7317620334428979200}]
I20260812 09:53:21.982606 27949 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:21.982817 27949 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:21.985893 27949 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Sending DeleteTablet for 3 replicas of tablet 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:21.986913 28092 tablet_service.cc:1514] Processing DeleteTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:21 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:34058
I20260812 09:53:21.986903 28403 tablet_service.cc:1514] Processing DeleteTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:21 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:49522
I20260812 09:53:21.986871 28252 tablet_service.cc:1514] Processing DeleteTablet for tablet 523fe7c9fc9841dd821e65edb362a6bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:21 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:44680
I20260812 09:53:21.987578 28517 tablet_replica.cc:330] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: stopping tablet replica
I20260812 09:53:21.987673 28519 tablet_replica.cc:330] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: stopping tablet replica
I20260812 09:53:21.988154 28517 raft_consensus.cc:2229] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:21.988232 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27995
I20260812 09:53:21.988212 28519 raft_consensus.cc:2229] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:21.988590 28517 raft_consensus.cc:2258] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:21.988616 28519 raft_consensus.cc:2258] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:21.992440 28517 ts_tablet_manager.cc:1905] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:21.996378 28517 ts_tablet_manager.cc:1918] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:21.996524 28517 log.cc:1196] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:21.997177 28517 ts_tablet_manager.cc:1939] T 523fe7c9fc9841dd821e65edb362a6bf P 46f7362a50fa4c5ea6d8d213118594b4: Deleting consensus metadata
I20260812 09:53:21.997170 28519 ts_tablet_manager.cc:1905] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:21.998792 27934 catalog_manager.cc:4841] TS 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): tablet 523fe7c9fc9841dd821e65edb362a6bf (table test-table [id=2ff540f94e874e069ea622784e64fb2b]) successfully deleted
I20260812 09:53:22.001019 28519 ts_tablet_manager.cc:1918] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:22.001147 28519 log.cc:1196] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:22.001578 28519 ts_tablet_manager.cc:1939] T 523fe7c9fc9841dd821e65edb362a6bf P 8e65bef9614a428cb80b3cbfe907676c: Deleting consensus metadata
I20260812 09:53:22.003402 27933 catalog_manager.cc:4841] TS 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): tablet 523fe7c9fc9841dd821e65edb362a6bf (table test-table [id=2ff540f94e874e069ea622784e64fb2b]) successfully deleted
W20260812 09:53:22.004206 27932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:40899 (error 108)
I20260812 09:53:22.005461 28487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.005112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:40899 (local address 127.0.0.1:34082)
0812 09:53:22.005262 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.005347 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:40899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 09:53:22.005689 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 28171
W20260812 09:53:22.005861 27932 catalog_manager.cc:4584] TS 9e8b01ceb1a64603b061a825f80f8852 (127.11.118.129:40899): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 523fe7c9fc9841dd821e65edb362a6bf: Network error: Client connection negotiation failed: client connection to 127.11.118.129:40899: connect: Connection refused (error 111)
I20260812 09:53:22.016765 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 28326
I20260812 09:53:22.025903 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 27910
I20260812 09:53:22.036550 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--webserver_interface=127.11.118.190
--webserver_port=37289
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:22.164903 28521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:22.165283 28521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:22.165364 28521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:22.169747 28521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:22.169879 28521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:22.169919 28521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:22.169957 28521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:22.169994 28521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:22.175944 28521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=37289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:22.177273 28521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:22.178423 28521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:22.188146 28529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.188314 28521 server_base.cc:1034] running on GCE node
W20260812 09:53:22.188223 28527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.188172 28532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.189145 28521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:22.190428 28521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:22.191651 28521 hybrid_clock.cc:648] HybridClock initialized: now 1786528402191617 us; error 55 us; skew 500 ppm
Aug 12 09:53:22 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:22.194782 28521 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:22.195894 28521 webserver.cc:460] Webserver started at http://127.11.118.190:37289/ using document root <none> and password file <none>
I20260812 09:53:22.196442 28521 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:22.196590 28521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:22.203313 28521 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:53:22.205960 28539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.207643 28521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:22.207840 28521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "51ac106a95754d52b20a762b2d4e65ab"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "297073f09f3dda4b0afd79ceccdf2ca6"
server_key_iv: "3ab7e6bdef57430ae421a1ec29c99a65"
server_key_version: "encryptionkey@0"
I20260812 09:53:22.208461 28521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:22.226691 28521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:22.230831 28521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:22.231086 28521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:22.239549 28521 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37129
I20260812 09:53:22.239575 28600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37129 every 8 connection(s)
I20260812 09:53:22.240824 28521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:22.246296 28601 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:53:22.246585 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28521
I20260812 09:53:22.247208 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:40899
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=32987
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:22.248579 28601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap starting.
I20260812 09:53:22.276721 28601 log.cc:824] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:22.292142 28601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:53:22.292727 28601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab: Bootstrap complete.
I20260812 09:53:22.300491 28601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:22.301108 28601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Initialized, Role: FOLLOWER
I20260812 09:53:22.301736 28601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:22.301903 28601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:22.301978 28601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:22.302088 28601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 2 FOLLOWER]: Advancing to term 3
I20260812 09:53:22.305644 28601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:22.306128 28601 leader_election.cc:302] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ac106a95754d52b20a762b2d4e65ab; no voters:
I20260812 09:53:22.306540 28601 leader_election.cc:288] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 09:53:22.306704 28605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 3 FOLLOWER]: Leader election won for term 3
I20260812 09:53:22.306994 28605 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [term 3 LEADER]: Becoming Leader. State: Replica: 51ac106a95754d52b20a762b2d4e65ab, State: Running, Role: LEADER
I20260812 09:53:22.307333 28605 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } }
I20260812 09:53:22.307938 28601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:22.308442 28605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ac106a95754d52b20a762b2d4e65ab. Latest consensus state: current_term: 3 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:22.308571 28605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:22.309022 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "51ac106a95754d52b20a762b2d4e65ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ac106a95754d52b20a762b2d4e65ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37129 } } }
I20260812 09:53:22.309141 28609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:22.310050 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ac106a95754d52b20a762b2d4e65ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:22.315641 28609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:22.316560 28609 catalog_manager.cc:1259] Loaded cluster ID: b4a631e156714431ae63337a64afe34c
I20260812 09:53:22.316762 28609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 09:53:22.317950 28609 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd464fcc9ad google::LogMessage::Fail() at ??:0
@ 0x7fd464fcf88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd464fcc4de google::LogMessage::Flush() at ??:0
@ 0x7fd464fcda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd46f90bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fd46f90cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd46f909579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fd46f94d640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fd46721e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd46721ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fd4672203f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fd46720f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd4688536db start_thread at ??:0
@ 0x7fd463aca61f clone at ??:0
W20260812 09:53:22.417511 28603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:22.417841 28603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:22.417940 28603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:22.422385 28603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:22.422498 28603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:22.422600 28603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:22.428496 28603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:40899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=32987
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:22.429728 28603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:22.430819 28603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:22.441385 28650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.441418 28653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.441418 28651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.442624 28603 server_base.cc:1034] running on GCE node
I20260812 09:53:22.443356 28603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:22.444181 28603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:22.445417 28603 hybrid_clock.cc:648] HybridClock initialized: now 1786528402445402 us; error 40 us; skew 500 ppm
Aug 12 09:53:22 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:22.448995 28603 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:22.450078 28603 webserver.cc:460] Webserver started at http://127.11.118.129:32987/ using document root <none> and password file <none>
I20260812 09:53:22.450692 28603 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:22.450798 28603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:22.455497 28603 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260812 09:53:22.458308 28661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.460165 28603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:22.460359 28603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "9e8b01ceb1a64603b061a825f80f8852"
format_stamp: "Formatted at 2026-08-12 09:53:19 on dist-test-slave-2w3w"
server_key: "f5b122b692ba9236e2919aa9c4f26f3b"
server_key_iv: "6503bc913a8d32a3d2ddef21418d474f"
server_key_version: "encryptionkey@0"
I20260812 09:53:22.461195 28603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:22.484628 28603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:22.489352 28603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:22.489602 28603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:22.490742 28603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:22.492285 28668 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 09:53:22.496877 28603 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 09:53:22.496989 28603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260812 09:53:22.497066 28603 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 09:53:22.499599 28603 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 09:53:22.499675 28603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:22.500097 28668 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap starting.
I20260812 09:53:22.511561 28603 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:40899
I20260812 09:53:22.511615 28790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:40899 every 8 connection(s)
I20260812 09:53:22.512902 28603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:22.518385 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28603
I20260812 09:53:22.519044 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:39565
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=35989
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:22.522464 28668 log.cc:824] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:22.533000 28668 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:53:22.533500 28668 tablet_bootstrap.cc:492] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Bootstrap complete.
I20260812 09:53:22.535214 28668 ts_tablet_manager.cc:1397] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Time spent bootstrapping tablet: real 0.035s user 0.026s sys 0.009s
I20260812 09:53:22.538992 28668 raft_consensus.cc:348] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:22.539695 28668 raft_consensus.cc:729] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8b01ceb1a64603b061a825f80f8852, State: Initialized, Role: FOLLOWER
I20260812 09:53:22.540340 28668 consensus_queue.cc:260] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:22.541601 28668 ts_tablet_manager.cc:1428] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260812 09:53:22.589640 28793 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:53:22.515502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:47557)
0812 09:53:22.516155 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.516220 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:22.517637 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:22.588599 (+ 70962us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":188,"threads_started":1}
W20260812 09:53:22.590394 28791 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:37129 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:37129: Client connection negotiation failed: client connection to 127.11.118.190:37129: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 09:53:22.591265 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.590920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:45073)
0812 09:53:22.591095 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.591185 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 09:53:22.592232 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.591882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:59955)
0812 09:53:22.592007 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.592065 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 09:53:22.592574 28791 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:53:22.649436 28794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:22.649801 28794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:22.649883 28794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:22.654335 28794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:22.654459 28794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:22.654564 28794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:22.660588 28794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:39565
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=35989
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:22.661825 28794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:22.662940 28794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:22.673945 28801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.674228 28794 server_base.cc:1034] running on GCE node
W20260812 09:53:22.673956 28804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.674094 28802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.674942 28794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:22.675726 28794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:22.676962 28794 hybrid_clock.cc:648] HybridClock initialized: now 1786528402676941 us; error 39 us; skew 500 ppm
Aug 12 09:53:22 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:22.680321 28794 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:22.681385 28794 webserver.cc:460] Webserver started at http://127.11.118.130:35989/ using document root <none> and password file <none>
I20260812 09:53:22.682006 28794 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:22.682108 28794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:22.686574 28794 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:22.689344 28814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.691119 28794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 09:53:22.691401 28794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "46f7362a50fa4c5ea6d8d213118594b4"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "7c01604ee9b339b23372e33066969a28"
server_key_iv: "6fa31e2c55eba5be60a37334e110aa52"
server_key_version: "encryptionkey@0"
I20260812 09:53:22.692176 28794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:22.708438 28794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:22.712656 28794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:22.712932 28794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:22.713650 28794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:22.714607 28794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:22.714685 28794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.714787 28794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:22.714838 28794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.725140 28794 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39565
I20260812 09:53:22.725229 28945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39565 every 8 connection(s)
I20260812 09:53:22.726265 28794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:22.729342 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28794
I20260812 09:53:22.729944 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:37635
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:37129
--webserver_port=42211
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:53:22.730934 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.728612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:56731)
0812 09:53:22.729274 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.729898 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":150,"threads_started":1}
W20260812 09:53:22.731434 28946 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:37129 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:37129: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
I20260812 09:53:22.732288 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.732014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:48919)
0812 09:53:22.732170 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.732226 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 09:53:22.733026 28948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.732767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:56871)
0812 09:53:22.732918 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.732975 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260812 09:53:22.733192 28946 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:53:22.860843 28949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:22.861152 28949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:22.861200 28949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:22.866571 28949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:22.866685 28949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:22.866762 28949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:22.873391 28949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:37635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=42211
--tserver_master_addrs=127.11.118.190:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:22.874604 28949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:22.875802 28949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:22.886269 28955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.886269 28957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:22.886265 28954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:22.886379 28949 server_base.cc:1034] running on GCE node
I20260812 09:53:22.887111 28949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:22.887851 28949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:22.889078 28949 hybrid_clock.cc:648] HybridClock initialized: now 1786528402889059 us; error 32 us; skew 500 ppm
Aug 12 09:53:22 dist-test-slave-2w3w krb5kdc[27277](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:22.892616 28949 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:22.893613 28949 webserver.cc:460] Webserver started at http://127.11.118.131:42211/ using document root <none> and password file <none>
I20260812 09:53:22.894223 28949 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:22.894335 28949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:22.899102 28949 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:22.901571 28964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.903155 28949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:22.903324 28949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "8e65bef9614a428cb80b3cbfe907676c"
format_stamp: "Formatted at 2026-08-12 09:53:20 on dist-test-slave-2w3w"
server_key: "b3cdc68a43cf7ba6121f5be3866c188a"
server_key_iv: "5a2547b3cfa5019b73297803eb9dca35"
server_key_version: "encryptionkey@0"
I20260812 09:53:22.904012 28949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:22.923939 28949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:22.927660 28949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:22.927929 28949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:22.928632 28949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:22.929596 28949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:22.929677 28949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.929754 28949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:22.929797 28949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:22.939888 28949 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:37635
I20260812 09:53:22.939975 29095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:37635 every 8 connection(s)
I20260812 09:53:22.941087 28949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:22.945516 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.943661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:49759)
0812 09:53:22.944227 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.944675 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":129,"threads_started":1}
W20260812 09:53:22.946115 29096 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:37129 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:37129: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
I20260812 09:53:22.946890 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.946587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:40649)
0812 09:53:22.946765 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.946826 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 09:53:22.947825 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:22.947623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:53181)
0812 09:53:22.947713 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:22.947760 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 09:53:22.948024 29096 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 09:53:22.949455 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 28949
I20260812 09:53:23.593977 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.593330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:40803)
0812 09:53:23.593668 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:23.593738 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":92,"threads_started":1}
I20260812 09:53:23.734325 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.733869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:35663)
0812 09:53:23.734146 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:23.734200 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":111,"threads_started":1}
I20260812 09:53:23.757460 29102 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:23.757730 29102 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:23.759025 29102 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
Aug 12 09:53:23 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.131@KRBTEST.COM
Aug 12 09:53:23 dist-test-slave-2w3w krb5kdc[27277](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528402, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.130@KRBTEST.COM
I20260812 09:53:23.780292 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.759305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37635 (local address 127.11.118.129:47451)
0812 09:53:23.759905 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:23.759921 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:23.760033 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:23.761712 (+ 1679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:23.761715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:23.761997 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:23.762469 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:23.762484 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.764275 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.764279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:23.765207 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:23.765219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.766352 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.766356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:23.766454 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:23.771826 (+ 5372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:23.771852 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:23.774003 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:23.776791 (+ 2788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:23.776798 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:23.776814 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:23.777276 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:23.777709 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:23.777713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:23.777716 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:23.777938 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:23.779104 (+ 1166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:23.779107 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:23.779282 (+ 175us) client_negotiation.cc:769] Sending connection context
0812 09:53:23.779499 (+ 217us) client_negotiation.cc:240] Negotiation successful
0812 09:53:23.779950 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":344,"spinlock_wait_cycles":70016,"thread_start_us":68,"threads_started":1}
I20260812 09:53:23.780316 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.759438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:46803 (local address 127.11.118.130:39565)
0812 09:53:23.759908 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:23.759933 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:23.759978 (+ 45us) server_negotiation.cc:407] Connection header received
0812 09:53:23.760675 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:23.760682 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:23.761036 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:23.761316 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:23.762676 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.763762 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.765379 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.765938 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.766124 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:23.774499 (+ 8375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:23.774505 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:23.774517 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:23.774550 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:23.776637 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:23.777493 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:23.777500 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:23.777505 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:23.777688 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:23.778078 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:23.778082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:23.778083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:23.778682 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:23.778833 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:23.779633 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 09:53:23.779997 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":141,"threads_started":1}
I20260812 09:53:23.780357 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.759580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47451 (local address 127.11.118.131:37635)
0812 09:53:23.759924 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:23.759939 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:23.759986 (+ 47us) server_negotiation.cc:407] Connection header received
0812 09:53:23.760731 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:23.760736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:23.761036 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:23.761339 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:23.762668 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.764068 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.765443 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.766068 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.766806 (+ 738us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:23.774382 (+ 7576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:23.774390 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:23.774406 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:23.774444 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:23.776614 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:23.777420 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:23.777427 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:23.777433 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:23.777568 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:23.778063 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:23.778066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:23.778068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:23.778682 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:23.778833 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:23.779673 (+ 840us) server_negotiation.cc:299] Negotiation successful
0812 09:53:23.780000 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":88,"threads_started":1}
I20260812 09:53:23.780411 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.759305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39565 (local address 127.11.118.129:46803)
0812 09:53:23.759500 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:23.759519 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:23.759641 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:23.761417 (+ 1776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:23.761423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:23.761969 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:23.762468 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:23.762484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.763973 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.763977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:23.765211 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:23.765223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:23.766091 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:23.766098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:23.766325 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:23.771826 (+ 5501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:23.771855 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:23.774217 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:23.776801 (+ 2584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:23.776805 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:23.776824 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:23.777290 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:23.777806 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:23.777810 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:23.777813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:23.777949 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:23.778818 (+ 869us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:23.778824 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:23.779290 (+ 466us) client_negotiation.cc:769] Sending connection context
0812 09:53:23.779500 (+ 210us) client_negotiation.cc:240] Negotiation successful
0812 09:53:23.780043 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":316,"spinlock_wait_cycles":32000}
W20260812 09:53:23.784471 28665 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
W20260812 09:53:23.784694 28664 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:23.784770 28665 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8b01ceb1a64603b061a825f80f8852; no voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c
I20260812 09:53:23.785115 29102 raft_consensus.cc:2726] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:53:23.949139 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:23.948668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:60407)
0812 09:53:23.948946 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:23.949020 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":72,"threads_started":1}
I20260812 09:53:24.595613 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:24.595110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:33041)
0812 09:53:24.595443 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:24.595503 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":107,"threads_started":1}
I20260812 09:53:24.735792 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:24.735281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:40053)
0812 09:53:24.735628 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:24.735693 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":91,"threads_started":1}
I20260812 09:53:24.950611 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:24.950104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:59723)
0812 09:53:24.950427 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:24.950496 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":113,"threads_started":1}
I20260812 09:53:25.597086 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:25.596573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:48043)
0812 09:53:25.596899 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:25.596972 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":93,"threads_started":1}
I20260812 09:53:25.737218 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:25.736704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:57771)
0812 09:53:25.737010 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:25.737086 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":81,"threads_started":1}
I20260812 09:53:25.915586 29112 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:25.915726 29112 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:25.916239 29112 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
W20260812 09:53:25.917279 28665 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
W20260812 09:53:25.917382 28664 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:25.917510 28664 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8b01ceb1a64603b061a825f80f8852; no voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c
I20260812 09:53:25.917707 29112 raft_consensus.cc:2726] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:53:25.952170 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:25.951701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:43689)
0812 09:53:25.952002 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:25.952069 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":83,"threads_started":1}
I20260812 09:53:26.598412 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:26.597923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:59365)
0812 09:53:26.598223 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:26.598308 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":90,"threads_started":1}
I20260812 09:53:26.738864 29115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:26.738250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:46021)
0812 09:53:26.738620 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:26.738702 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":95,"threads_started":1}
I20260812 09:53:26.953639 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:26.953160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:36549)
0812 09:53:26.953467 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:26.953536 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":93,"threads_started":1}
I20260812 09:53:27.600039 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:27.599522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:35353)
0812 09:53:27.599856 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:27.599924 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":82,"threads_started":1}
I20260812 09:53:27.740331 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:27.739847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:47569)
0812 09:53:27.740158 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:27.740225 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":84,"threads_started":1}
I20260812 09:53:27.955160 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:27.954625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:52623)
0812 09:53:27.954937 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:27.955059 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":99,"threads_started":1}
I20260812 09:53:28.601384 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:28.600915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:42889)
0812 09:53:28.601212 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:28.601278 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":80,"threads_started":1}
I20260812 09:53:28.741945 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:28.741412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:43225)
0812 09:53:28.741732 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:28.741792 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":98,"threads_started":1}
I20260812 09:53:28.925323 29122 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:28.925539 29122 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:28.926039 29122 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
W20260812 09:53:28.927100 28665 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
W20260812 09:53:28.927204 28664 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:28.927328 28664 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8b01ceb1a64603b061a825f80f8852; no voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c
I20260812 09:53:28.927527 29122 raft_consensus.cc:2726] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:53:28.956548 29123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:28.956032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:47083)
0812 09:53:28.956363 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:28.956431 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":83,"threads_started":1}
I20260812 09:53:29.602705 29124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:29.602235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:54725)
0812 09:53:29.602539 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:29.602600 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":104,"threads_started":1}
I20260812 09:53:29.743723 29125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:29.743151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:55735)
0812 09:53:29.743548 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:29.743619 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":103,"threads_started":1}
I20260812 09:53:29.958237 29126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:29.957618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:42511)
0812 09:53:29.958014 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:29.958088 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":83,"threads_started":1}
I20260812 09:53:30.604176 29127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:30.603706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:34941)
0812 09:53:30.604004 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:30.604072 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":88,"threads_started":1}
I20260812 09:53:30.745301 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:30.744744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:51535)
0812 09:53:30.745124 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:30.745195 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":132,"threads_started":1}
I20260812 09:53:30.959774 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:30.959243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:45909)
0812 09:53:30.959604 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:30.959672 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":134,"threads_started":1}
I20260812 09:53:30.975030 29130 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:30.975203 29130 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:30.975685 29130 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
W20260812 09:53:30.976573 28665 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
W20260812 09:53:30.976679 28664 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:30.976807 28664 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8b01ceb1a64603b061a825f80f8852; no voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c
I20260812 09:53:30.977003 29130 raft_consensus.cc:2726] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:53:31.605767 29131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:31.605266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:51145)
0812 09:53:31.605594 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:31.605660 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":93,"threads_started":1}
I20260812 09:53:31.746941 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:31.746356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:33603)
0812 09:53:31.746695 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:31.746831 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260812 09:53:31.961263 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:31.960748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:52615)
0812 09:53:31.961082 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:31.961160 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":98,"threads_started":1}
I20260812 09:53:32.607477 29135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:32.606860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:37521)
0812 09:53:32.607308 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:32.607377 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":247,"threads_started":1}
I20260812 09:53:32.748624 29136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:32.748049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:58819)
0812 09:53:32.748459 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:32.748524 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":93,"threads_started":1}
I20260812 09:53:32.962824 29137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:32.962245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:59535)
0812 09:53:32.962636 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:32.962705 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":83,"threads_started":1}
I20260812 09:53:33.565564 29138 raft_consensus.cc:482] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:33.565804 29138 raft_consensus.cc:504] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e65bef9614a428cb80b3cbfe907676c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37635 } } peers { permanent_uuid: "46f7362a50fa4c5ea6d8d213118594b4" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39565 } } peers { permanent_uuid: "9e8b01ceb1a64603b061a825f80f8852" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 40899 } }
I20260812 09:53:33.566388 29138 leader_election.cc:288] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635), 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565)
W20260812 09:53:33.567499 28664 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e65bef9614a428cb80b3cbfe907676c (127.11.118.131:37635): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
W20260812 09:53:33.567633 28665 leader_election.cc:341] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46f7362a50fa4c5ea6d8d213118594b4 (127.11.118.130:39565): Not found: Tablet not found: 523fe7c9fc9841dd821e65edb362a6bf
I20260812 09:53:33.567751 28665 leader_election.cc:302] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8b01ceb1a64603b061a825f80f8852; no voters: 46f7362a50fa4c5ea6d8d213118594b4, 8e65bef9614a428cb80b3cbfe907676c
I20260812 09:53:33.567948 29138 raft_consensus.cc:2726] T 523fe7c9fc9841dd821e65edb362a6bf P 9e8b01ceb1a64603b061a825f80f8852 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:53:33.609628 29139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:33.608847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:56893)
0812 09:53:33.609331 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:33.609440 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":111,"threads_started":1}
I20260812 09:53:33.749958 29140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:33.749505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:51467)
0812 09:53:33.749787 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:33.749848 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":83,"threads_started":1}
I20260812 09:53:33.964752 29141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:33.963993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:39427)
0812 09:53:33.964561 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:33.964642 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":91,"threads_started":1}
I20260812 09:53:34.611127 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:34.610564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:39411)
0812 09:53:34.610873 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:34.610942 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":92,"threads_started":1}
I20260812 09:53:34.751549 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:34.750871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:38353)
0812 09:53:34.751343 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:34.751422 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":247,"threads_started":1}
I20260812 09:53:34.966073 29146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:34.965625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:50459)
0812 09:53:34.965904 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:34.965971 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":78,"threads_started":1}
I20260812 09:53:35.612717 29147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:35.612245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:36365)
0812 09:53:35.612549 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:35.612614 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":90,"threads_started":1}
I20260812 09:53:35.752882 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:35.752363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:34217)
0812 09:53:35.752658 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:35.752725 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":81,"threads_started":1}
I20260812 09:53:35.967896 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:35.967346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:59621)
0812 09:53:35.967696 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:35.967784 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":79,"threads_started":1}
I20260812 09:53:36.614301 29150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:36.613781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:45225)
0812 09:53:36.614127 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:36.614195 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":86,"threads_started":1}
I20260812 09:53:36.754436 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:36.753919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:34065)
0812 09:53:36.754251 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:36.754320 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":93,"threads_started":1}
I20260812 09:53:36.969573 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:36.969089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:48645)
0812 09:53:36.969400 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:36.969470 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":82,"threads_started":1}
I20260812 09:53:37.616070 29153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:37.615638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.129:54833)
0812 09:53:37.615906 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:37.615960 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":78,"threads_started":1}
I20260812 09:53:37.756088 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:37.755638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.130:42861)
0812 09:53:37.755919 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:37.755984 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":79,"threads_started":1}
I20260812 09:53:37.961159 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 28603
I20260812 09:53:37.971257 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:37.970725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:37129 (local address 127.11.118.131:50977)
0812 09:53:37.971090 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:37.971156 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":97,"threads_started":1}
I20260812 09:53:37.972323 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 28794
I20260812 09:53:37.983613 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 28949
2026-08-12T09:53:37Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19817 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:53:38 dist-test-slave-2w3w krb5kdc[29161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:53:38 dist-test-slave-2w3w krb5kdc[29161](info): set up 2 sockets
Aug 12 09:53:38 dist-test-slave-2w3w krb5kdc[29161](info): commencing operation
krb5kdc: starting...
W20260812 09:53:39.140084 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:53:39 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:53:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:53:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:53:39.292351 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:39.415026 29177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:39.415395 29177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:39.415467 29177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:39.419988 29177 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 09:53:39.420090 29177 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 09:53:39.420120 29177 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 09:53:39.420143 29177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:53:39.420186 29177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:39.420228 29177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:39.420262 29177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:53:39.420296 29177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:53:39.426241 29177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:39.427548 29177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:39.428666 29177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:39.438345 29182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:39.438524 29185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:39.438418 29177 server_base.cc:1034] running on GCE node
W20260812 09:53:39.438731 29183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:39.439492 29177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:39.440953 29177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:39.442286 29177 hybrid_clock.cc:648] HybridClock initialized: now 1786528419442252 us; error 55 us; skew 500 ppm
Aug 12 09:53:39 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528419, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:39.445834 29177 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:53:39.446947 29177 webserver.cc:460] Webserver started at http://127.11.118.190:39509/ using document root <none> and password file <none>
I20260812 09:53:39.447643 29177 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:39.447712 29177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:39.447961 29177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:39.450163 29177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "95d3ce95de1f48ac97b189b9e37847a6"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "a5dd2d5c61f5ae22a1f332efd69966e7"
server_key_iv: "058e40159438a1177481f4b36a86736c"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.450776 29177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "95d3ce95de1f48ac97b189b9e37847a6"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "a5dd2d5c61f5ae22a1f332efd69966e7"
server_key_iv: "058e40159438a1177481f4b36a86736c"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.454804 29177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 09:53:39.457442 29192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:39.458885 29177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:53:39.459084 29177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "95d3ce95de1f48ac97b189b9e37847a6"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "a5dd2d5c61f5ae22a1f332efd69966e7"
server_key_iv: "058e40159438a1177481f4b36a86736c"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.459218 29177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:39.477174 29177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:39.480854 29177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:39.481086 29177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:39.488986 29177 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:42505
I20260812 09:53:39.489322 29252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:42505 every 8 connection(s)
I20260812 09:53:39.490047 29177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:53:39.491175 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29177
I20260812 09:53:39.491309 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:53:39.491612 11738 external_mini_cluster.cc:1428] Setting key 8ff707764bdf84088bd918c5fcb34ccd
I20260812 09:53:39.493564 29253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:39.500447 29253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap starting.
Aug 12 09:53:39 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:39.503069 29253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:39.503875 29253 log.cc:824] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:39.506361 29253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: No bootstrap required, opened a new log
I20260812 09:53:39.507009 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:39.493081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.11.118.190:42505)
0812 09:53:39.493525 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:39.493541 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:39.493578 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:53:39.494299 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:39.494316 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:39.494644 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:39.494949 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:39.495932 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.497009 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.498152 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.498617 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.498743 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:39.501772 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:39.501777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:39.501791 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:39.501821 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:39.503785 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:39.504347 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:39.504356 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:39.504362 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:39.504515 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:39.504909 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:39.504912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:39.504913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:39.505335 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:39.505481 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:39.505800 (+ 319us) server_negotiation.cc:299] Negotiation successful
0812 09:53:39.506124 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":160,"threads_started":1}
I20260812 09:53:39.510320 29253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:53:39.510577 29253 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:39.510667 29253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Initialized, Role: FOLLOWER
I20260812 09:53:39.511148 29253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:53:39.511303 29253 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:53:39.511369 29253 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:53:39.511482 29253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:39.512523 29253 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:53:39.512877 29253 leader_election.cc:302] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d3ce95de1f48ac97b189b9e37847a6; no voters:
I20260812 09:53:39.513223 29253 leader_election.cc:288] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:53:39.513516 29258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:39.513783 29258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 LEADER]: Becoming Leader. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Running, Role: LEADER
I20260812 09:53:39.514111 29258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:53:39.514565 29253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:53:39.515753 29260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d3ce95de1f48ac97b189b9e37847a6. Latest consensus state: current_term: 1 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:53:39.515883 29260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:39.516311 29269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:53:39.516269 29259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:53:39.516357 29259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:53:39.519554 29269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:53:39.525581 29269 catalog_manager.cc:1347] Generated new cluster ID: 485d6e6af3ee4e32b230bd634d6fd72b
I20260812 09:53:39.525677 29269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:53:39.555994 29269 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:53:39.557420 29269 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:53:39.569747 29269 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Generated new TSK 0
I20260812 09:53:39.570566 29269 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:53:39.607818 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:39.730093 29284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:39.730432 29284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:39.730520 29284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:39.734789 29284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:39.734905 29284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:39.735030 29284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:53:39.740720 29284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:39.741842 29284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:39.742873 29284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:39.754032 29292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:39.754001 29294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:39.754035 29291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:39.754397 29284 server_base.cc:1034] running on GCE node
I20260812 09:53:39.754930 29284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:39.755667 29284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:39.756889 29284 hybrid_clock.cc:648] HybridClock initialized: now 1786528419756875 us; error 28 us; skew 500 ppm
Aug 12 09:53:39 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528419, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:39.760097 29284 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:53:39.761127 29284 webserver.cc:460] Webserver started at http://127.11.118.129:34277/ using document root <none> and password file <none>
I20260812 09:53:39.761737 29284 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:39.761840 29284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:39.762094 29284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:39.764530 29284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "4ef060634fab43899a3e157ef582badf"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "f2f2d1960c3972a189797033e1ba720e"
server_key_iv: "38751cee39ba5c82b847090c93ad760f"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.765159 29284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "4ef060634fab43899a3e157ef582badf"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "f2f2d1960c3972a189797033e1ba720e"
server_key_iv: "38751cee39ba5c82b847090c93ad760f"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.769533 29284 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:53:39.772146 29304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:39.773459 29284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:53:39.773600 29284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "4ef060634fab43899a3e157ef582badf"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "f2f2d1960c3972a189797033e1ba720e"
server_key_iv: "38751cee39ba5c82b847090c93ad760f"
server_key_version: "encryptionkey@0"
I20260812 09:53:39.773725 29284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:39.794373 29284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:39.798065 29284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:39.798303 29284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:39.798980 29284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:39.799862 29284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:39.799943 29284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:39.800020 29284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:39.800074 29284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:39.810169 29284 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38291
I20260812 09:53:39.810189 29428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38291 every 8 connection(s)
I20260812 09:53:39.811215 29284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:53:39.816797 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29284
I20260812 09:53:39.816944 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:53:39.817278 11738 external_mini_cluster.cc:1428] Setting key d8d8fbbc2613588ba3535a19cb905824
Aug 12 09:53:39 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528419, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:39.828004 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:39.813270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:44719 (local address 127.11.118.190:42505)
0812 09:53:39.813479 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:39.813484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:39.814252 (+ 768us) server_negotiation.cc:407] Connection header received
0812 09:53:39.815693 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:39.815696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:39.815746 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:39.815822 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:39.817415 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.818158 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.819915 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.820150 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.820236 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:39.823349 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:39.823356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:39.823362 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:39.823397 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:39.825289 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:39.826017 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:39.826025 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:39.826028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:39.826141 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:39.826552 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:39.826556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:39.826558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:39.826840 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:39.826948 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:39.827644 (+ 696us) server_negotiation.cc:299] Negotiation successful
0812 09:53:39.827811 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:53:39.828915 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:39.813617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:44719)
0812 09:53:39.814091 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:39.814135 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:39.815442 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:39.816028 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:39.816035 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:39.816409 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:39.817226 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:39.817248 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.818298 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.818301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:39.819748 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:39.819764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:39.820319 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:39.820326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:39.820565 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:39.821337 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:39.821354 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:39.823159 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:39.825471 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:39.825476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:39.825492 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:39.825874 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:39.826261 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:39.826264 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:39.826265 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:39.826428 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:39.827019 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:39.827033 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:39.827346 (+ 313us) client_negotiation.cc:769] Sending connection context
0812 09:53:39.827526 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 09:53:39.827890 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":132,"threads_started":1}
I20260812 09:53:39.830490 29429 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:53:39.830749 29429 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:39.831333 29429 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:53:39.833061 29211 ts_manager.cc:194] Registered new tserver with Master: 4ef060634fab43899a3e157ef582badf (127.11.118.129:38291)
I20260812 09:53:39.834232 29211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:44719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:53:39.851529 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:39.973985 29434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:39.974392 29434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:39.974449 29434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:39.979386 29434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:39.979468 29434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:39.979534 29434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:53:39.985551 29434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:39.986686 29434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:39.987828 29434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:39.998965 29442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:39.998977 29444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:39.999024 29441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:39.999063 29434 server_base.cc:1034] running on GCE node
I20260812 09:53:39.999753 29434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:40.000538 29434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:40.001823 29434 hybrid_clock.cc:648] HybridClock initialized: now 1786528420001794 us; error 43 us; skew 500 ppm
Aug 12 09:53:40 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528420, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:40.005789 29434 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:53:40.007413 29434 webserver.cc:460] Webserver started at http://127.11.118.130:35437/ using document root <none> and password file <none>
I20260812 09:53:40.008105 29434 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:40.008177 29434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:40.008438 29434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:40.010680 29434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "84cd3c0699c74f73b9f0924c014088ab"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "3a152b4865e6988de6c408b48c94a1ee"
server_key_iv: "c0d3bbd3267320d07f2de8915c4d3501"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.011387 29434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "84cd3c0699c74f73b9f0924c014088ab"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "3a152b4865e6988de6c408b48c94a1ee"
server_key_iv: "c0d3bbd3267320d07f2de8915c4d3501"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.015921 29434 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:53:40.019186 29453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.020990 29434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:53:40.021127 29434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "84cd3c0699c74f73b9f0924c014088ab"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "3a152b4865e6988de6c408b48c94a1ee"
server_key_iv: "c0d3bbd3267320d07f2de8915c4d3501"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.021334 29434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:40.038580 29434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:40.042591 29434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:40.042824 29434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:40.043529 29434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:40.044492 29434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:40.044559 29434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.044603 29434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:40.044653 29434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.054793 29434 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:44871
I20260812 09:53:40.054817 29582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:44871 every 8 connection(s)
I20260812 09:53:40.055878 29434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:53:40.060544 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29434
I20260812 09:53:40.060688 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:53:40.061004 11738 external_mini_cluster.cc:1428] Setting key 103f01624fccb2a7ccee229ea6be8bc4
Aug 12 09:53:40 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528420, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:40.072026 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.057946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:35279 (local address 127.11.118.190:42505)
0812 09:53:40.058136 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.058141 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.059046 (+ 905us) server_negotiation.cc:407] Connection header received
0812 09:53:40.060402 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.060406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.060466 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.060578 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:40.062021 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.062694 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.064105 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.064336 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.064454 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.067790 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:40.067794 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:40.067797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:40.067829 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:40.069691 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.070347 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.070351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.070352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.070430 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.070793 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.070796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.070798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.071063 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:40.071170 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.071723 (+ 553us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.071859 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:53:40.072961 29586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.058349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:35279)
0812 09:53:40.058844 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.058894 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.060179 (+ 1285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.060782 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.060793 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.061251 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:40.061869 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.061885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.062841 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.062845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.063975 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.063986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.064500 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.064504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.064681 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.065418 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:40.065446 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:40.067578 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:40.069861 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:40.069874 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:40.069889 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:40.070219 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:40.070525 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:40.070529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:40.070531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:40.070685 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:40.071170 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:40.071178 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:40.071460 (+ 282us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.071665 (+ 205us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.072039 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":127,"threads_started":1}
I20260812 09:53:40.074296 29583 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:53:40.074569 29583 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:40.075248 29583 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:53:40.076634 29211 ts_manager.cc:194] Registered new tserver with Master: 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:53:40.077201 29211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:35279
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:53:40.100744 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:53:40.239174 29591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:53:40.239482 29591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:53:40.239528 29591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:53:40.244343 29591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:53:40.244442 29591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:53:40.244508 29591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:53:40.250697 29591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:53:40.251991 29591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:53:40.253090 29591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:53:40.263808 29597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:40.263806 29599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:53:40.263845 29596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:53:40.264285 29591 server_base.cc:1034] running on GCE node
I20260812 09:53:40.264879 29591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:53:40.265619 29591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:53:40.266839 29591 hybrid_clock.cc:648] HybridClock initialized: now 1786528420266794 us; error 57 us; skew 500 ppm
Aug 12 09:53:40 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528420, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:53:40.269977 29591 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:53:40.270941 29591 webserver.cc:460] Webserver started at http://127.11.118.131:41271/ using document root <none> and password file <none>
I20260812 09:53:40.271570 29591 fs_manager.cc:359] Metadata directory not provided
I20260812 09:53:40.271636 29591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:53:40.271862 29591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:53:40.274088 29591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "7a097bd0298f4921954b73986165700a"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "798724ef457db55652f0a47ac1bba1fd"
server_key_iv: "a6483bba6715f4bc8fb802dc0fa27089"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.274744 29591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "7a097bd0298f4921954b73986165700a"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "798724ef457db55652f0a47ac1bba1fd"
server_key_iv: "a6483bba6715f4bc8fb802dc0fa27089"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.279793 29591 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260812 09:53:40.282714 29606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.284237 29591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:53:40.284392 29591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "7a097bd0298f4921954b73986165700a"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "798724ef457db55652f0a47ac1bba1fd"
server_key_iv: "a6483bba6715f4bc8fb802dc0fa27089"
server_key_version: "encryptionkey@0"
I20260812 09:53:40.284533 29591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:53:40.306928 29591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:53:40.310552 29591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:53:40.310791 29591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:53:40.311457 29591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:53:40.312379 29591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:53:40.312474 29591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.312551 29591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:53:40.312608 29591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:53:40.322853 29591 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:36837
I20260812 09:53:40.322996 29737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:36837 every 8 connection(s)
I20260812 09:53:40.323871 29591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:53:40.330186 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29591
I20260812 09:53:40.330329 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:53:40.330659 11738 external_mini_cluster.cc:1428] Setting key 53ad0ec56f579f7c78da8e50eb918bd7
Aug 12 09:53:40 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528420, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:53:40.338775 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.325946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:51773 (local address 127.11.118.190:42505)
0812 09:53:40.326143 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.326148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.327031 (+ 883us) server_negotiation.cc:407] Connection header received
0812 09:53:40.328338 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.328341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.328388 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.328466 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:40.329816 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.330662 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.332188 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.332436 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.332523 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.335316 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:40.335320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:40.335322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:40.335348 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:40.336813 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.337347 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.337350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.337351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.337429 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.337740 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.337742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.337743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.337929 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:40.338006 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.338532 (+ 526us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.338642 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:53:40.339653 29741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.326369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:51773)
0812 09:53:40.326851 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.326896 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.328115 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.328631 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.328637 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.329043 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:53:40.329636 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.329663 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.330844 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.330847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.332081 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.332090 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.332596 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.332600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.332860 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.333554 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:53:40.333571 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:53:40.335126 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:53:40.336942 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:40.336947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:40.336961 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:40.337223 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:40.337513 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:53:40.337515 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:53:40.337516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:53:40.337647 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:53:40.338023 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:53:40.338028 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:53:40.338282 (+ 254us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.338443 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.338707 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":119,"threads_started":1}
I20260812 09:53:40.340886 29738 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:53:40.341130 29738 heartbeater.cc:464] Registering TS with master...
I20260812 09:53:40.341599 29738 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
I20260812 09:53:40.342859 29211 ts_manager.cc:194] Registered new tserver with Master: 7a097bd0298f4921954b73986165700a (127.11.118.131:36837)
I20260812 09:53:40.343528 29211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:51773
I20260812 09:53:40.344977 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:53:40.355765 29256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.347299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41998 (local address 127.11.118.190:42505)
0812 09:53:40.347472 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.347478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.347613 (+ 135us) server_negotiation.cc:407] Connection header received
0812 09:53:40.347706 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.347708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.347749 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.347818 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:53:40.348571 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.349098 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.350066 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.350286 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.350389 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.352032 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:53:40.352035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:53:40.352037 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:53:40.352063 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:53:40.353676 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.354382 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.354385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.354387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.354483 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:53:40.354743 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:53:40.354745 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:53:40.354746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:53:40.355102 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:53:40.355213 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.355458 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.355563 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260812 09:53:40.359305 29209 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:53:40.362387 29209 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:53:40.378727 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.372308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.11.118.130:44871)
0812 09:53:40.372591 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.372603 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.373139 (+ 536us) server_negotiation.cc:407] Connection header received
0812 09:53:40.373222 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.373227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.373394 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.373550 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:40.375071 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.376127 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.377337 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.378095 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.378224 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.378351 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.378470 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.378559 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
I20260812 09:53:40.378775 29754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.371839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.11.118.131:36837)
0812 09:53:40.372204 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.372217 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.372651 (+ 434us) server_negotiation.cc:407] Connection header received
0812 09:53:40.372886 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.372890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.373068 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.373205 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:40.373744 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.374877 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.377147 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.377868 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.377985 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.378092 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.378399 (+ 307us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.378564 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":126,"threads_started":1}
I20260812 09:53:40.379256 29751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.371384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:36837 (local address 127.0.0.1:38774)
0812 09:53:40.372560 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.372576 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.372726 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.373427 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.373430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.373454 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:40.373589 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.373595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.375047 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.375051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.376998 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.377009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.377998 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.378002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.378147 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.378208 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.378993 (+ 785us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.379113 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"mutex_wait_us":233,"thread_start_us":138,"threads_started":1}
I20260812 09:53:40.379657 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.371444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46934 (local address 127.11.118.129:38291)
0812 09:53:40.372289 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.372298 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.372327 (+ 29us) server_negotiation.cc:407] Connection header received
0812 09:53:40.372850 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.372857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.373069 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.373244 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:40.373612 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.374877 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.378149 (+ 3272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.379019 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.379206 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.379340 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.379389 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.379491 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":119,"threads_started":1}
I20260812 09:53:40.380082 29755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.372101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.0.0.1:45062)
0812 09:53:40.372919 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.372932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.373044 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.373533 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.373535 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.373551 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:40.373647 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.373655 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.376271 (+ 2616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.376275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.377176 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.377186 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.378227 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.378231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.378339 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.378362 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.378445 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.379946 (+ 1501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":52,"thread_start_us":92,"threads_started":1}
I20260812 09:53:40.382578 29510 tablet_service.cc:1467] Processing CreateTablet for tablet ceb2156e59d94a1eb304028423337a5b (DEFAULT_TABLE table=test-table [id=dda471e92fad4a3bbd327a2e3b08090a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:40.382578 29661 tablet_service.cc:1467] Processing CreateTablet for tablet ceb2156e59d94a1eb304028423337a5b (DEFAULT_TABLE table=test-table [id=dda471e92fad4a3bbd327a2e3b08090a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:40.383247 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.371310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38291 (local address 127.0.0.1:46934)
0812 09:53:40.371934 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.372010 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.372640 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.373251 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.373257 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.373280 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:40.373455 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.373467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.375049 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.375051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.376998 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.377009 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.379125 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.379128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.379230 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.379251 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.379321 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.379408 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":257,"thread_start_us":110,"threads_started":1}
I20260812 09:53:40.383906 29510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb2156e59d94a1eb304028423337a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:40.383909 29661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb2156e59d94a1eb304028423337a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:40.389076 29357 tablet_service.cc:1467] Processing CreateTablet for tablet ceb2156e59d94a1eb304028423337a5b (DEFAULT_TABLE table=test-table [id=dda471e92fad4a3bbd327a2e3b08090a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:53:40.390141 29357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb2156e59d94a1eb304028423337a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:53:40.392483 29757 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Bootstrap starting.
I20260812 09:53:40.393833 29758 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Bootstrap starting.
I20260812 09:53:40.394538 29757 tablet_bootstrap.cc:654] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:40.395879 29757 log.cc:824] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:40.396677 29758 tablet_bootstrap.cc:654] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:40.397559 29758 log.cc:824] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:40.397943 29757 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: No bootstrap required, opened a new log
I20260812 09:53:40.398156 29757 ts_tablet_manager.cc:1397] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260812 09:53:40.398181 29760 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Bootstrap starting.
I20260812 09:53:40.400635 29760 tablet_bootstrap.cc:654] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Neither blocks nor log segments found. Creating new log.
I20260812 09:53:40.401530 29760 log.cc:824] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Log is configured to *not* fsync() on all Append() calls
I20260812 09:53:40.402334 29757 raft_consensus.cc:348] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.402669 29757 raft_consensus.cc:374] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:40.402729 29757 raft_consensus.cc:729] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a097bd0298f4921954b73986165700a, State: Initialized, Role: FOLLOWER
I20260812 09:53:40.403226 29757 consensus_queue.cc:260] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.403900 29760 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: No bootstrap required, opened a new log
I20260812 09:53:40.403901 29758 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: No bootstrap required, opened a new log
I20260812 09:53:40.404121 29760 ts_tablet_manager.cc:1397] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260812 09:53:40.404121 29758 ts_tablet_manager.cc:1397] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260812 09:53:40.404544 29757 ts_tablet_manager.cc:1428] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 09:53:40.404920 29738 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
I20260812 09:53:40.409060 29760 raft_consensus.cc:348] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.409409 29760 raft_consensus.cc:374] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:40.409475 29760 raft_consensus.cc:729] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Initialized, Role: FOLLOWER
I20260812 09:53:40.409994 29760 consensus_queue.cc:260] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.410809 29429 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
I20260812 09:53:40.410815 29758 raft_consensus.cc:348] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.411164 29758 raft_consensus.cc:374] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:53:40.411250 29758 raft_consensus.cc:729] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84cd3c0699c74f73b9f0924c014088ab, State: Initialized, Role: FOLLOWER
I20260812 09:53:40.411257 29760 ts_tablet_manager.cc:1428] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:53:40.411705 29758 consensus_queue.cc:260] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.412480 29583 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
I20260812 09:53:40.412757 29758 ts_tablet_manager.cc:1428] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
W20260812 09:53:40.557370 29584 tablet.cc:2369] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:53:40.563025 29430 tablet.cc:2369] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:53:40.575068 29739 tablet.cc:2369] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:53:40.613943 29764 raft_consensus.cc:482] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:53:40.614164 29764 raft_consensus.cc:504] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.615504 29764 leader_election.cc:288] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:53:40.619786 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.615959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:38477 (local address 127.11.118.130:44871)
0812 09:53:40.616097 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.616104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.616449 (+ 345us) server_negotiation.cc:407] Connection header received
0812 09:53:40.616607 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.616611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.616662 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.616796 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:40.617089 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.617588 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.618650 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.619124 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.619253 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.619307 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.619570 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.619644 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:53:40.619786 29754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.615949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:35967 (local address 127.11.118.131:36837)
0812 09:53:40.616097 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.616102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.616317 (+ 215us) server_negotiation.cc:407] Connection header received
0812 09:53:40.616489 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.616499 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.616543 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.616628 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:53:40.616959 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.617476 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.618651 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.619129 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.619267 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.619325 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.619572 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.619646 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:53:40.619820 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.615840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.11.118.129:38477)
0812 09:53:40.616330 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.616343 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.616501 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.616807 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.616810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.616826 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:40.616969 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.616975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.617703 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.617707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.618521 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.618530 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.619252 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.619256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.619424 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.619459 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.619551 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.619645 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":84,"thread_start_us":117,"threads_started":1}
I20260812 09:53:40.619828 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.615813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:36837 (local address 127.11.118.129:35967)
0812 09:53:40.616215 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.616230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:53:40.616375 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:53:40.616646 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:53:40.616649 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:53:40.616665 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:53:40.616848 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.616857 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.617600 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.617604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.618516 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:53:40.618527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.619256 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.619259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:53:40.619433 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.619463 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 09:53:40.619555 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 09:53:40.619652 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":74,"thread_start_us":131,"threads_started":1}
I20260812 09:53:40.620429 29531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb2156e59d94a1eb304028423337a5b" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84cd3c0699c74f73b9f0924c014088ab" is_pre_election: true
I20260812 09:53:40.620642 29683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb2156e59d94a1eb304028423337a5b" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a097bd0298f4921954b73986165700a" is_pre_election: true
I20260812 09:53:40.620761 29531 raft_consensus.cc:2454] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 0.
I20260812 09:53:40.620872 29683 raft_consensus.cc:2454] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 0.
I20260812 09:53:40.621315 29305 leader_election.cc:302] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef060634fab43899a3e157ef582badf, 84cd3c0699c74f73b9f0924c014088ab; no voters:
I20260812 09:53:40.621601 29764 raft_consensus.cc:2781] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:53:40.621706 29764 raft_consensus.cc:482] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:53:40.621766 29764 raft_consensus.cc:3037] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:40.623417 29764 raft_consensus.cc:504] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.623828 29764 leader_election.cc:288] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 election: Requested vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:53:40.624315 29683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb2156e59d94a1eb304028423337a5b" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a097bd0298f4921954b73986165700a"
I20260812 09:53:40.624347 29531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb2156e59d94a1eb304028423337a5b" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84cd3c0699c74f73b9f0924c014088ab"
I20260812 09:53:40.624475 29531 raft_consensus.cc:3037] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:40.624493 29683 raft_consensus.cc:3037] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:53:40.625898 29683 raft_consensus.cc:2454] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 1.
I20260812 09:53:40.625898 29531 raft_consensus.cc:2454] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 1.
I20260812 09:53:40.626271 29307 leader_election.cc:302] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef060634fab43899a3e157ef582badf, 7a097bd0298f4921954b73986165700a; no voters:
I20260812 09:53:40.626528 29764 raft_consensus.cc:2781] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:53:40.626793 29764 raft_consensus.cc:686] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 LEADER]: Becoming Leader. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Running, Role: LEADER
I20260812 09:53:40.627249 29764 consensus_queue.cc:237] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:53:40.630543 29209 catalog_manager.cc:5495] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef060634fab43899a3e157ef582badf (127.11.118.129). New cstate: current_term: 1 leader_uuid: "4ef060634fab43899a3e157ef582badf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } health_report { overall_health: UNKNOWN } } }
I20260812 09:53:40.678165 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.674279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46950 (local address 127.11.118.129:38291)
0812 09:53:40.674433 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 09:53:40.674440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:53:40.674458 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:53:40.674561 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:53:40.674563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:53:40.674619 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:53:40.674756 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:53:40.675105 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.675655 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.676568 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:53:40.676803 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:53:40.676925 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:53:40.677276 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:53:40.677753 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:53:40.677894 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 09:53:40.677939 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 09:53:40.678004 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:53:40.684729 29683 raft_consensus.cc:1261] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Refusing update from remote peer 4ef060634fab43899a3e157ef582badf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:40.684729 29531 raft_consensus.cc:1261] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Refusing update from remote peer 4ef060634fab43899a3e157ef582badf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:53:40.685547 29769 consensus_queue.cc:1035] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:40.685803 29764 consensus_queue.cc:1035] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [LEADER]: Connected to new peer: Peer: permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:53:40.695348 29772 mvcc.cc:205] Tried to move back new op lower bound from 7317620411116044288 to 7317620410891927552. Current Snapshot: MvccSnapshot[applied={T|T < 7317620411116044288}]
I20260812 09:53:40.695674 29773 mvcc.cc:205] Tried to move back new op lower bound from 7317620411116044288 to 7317620410891927552. Current Snapshot: MvccSnapshot[applied={T|T < 7317620411116044288}]
I20260812 09:53:40.705062 29209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:40.705273 29209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:53:40.707971 29209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Sending DeleteTablet for 3 replicas of tablet ceb2156e59d94a1eb304028423337a5b
I20260812 09:53:40.708966 29661 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb2156e59d94a1eb304028423337a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:40 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:38774
I20260812 09:53:40.708966 29510 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb2156e59d94a1eb304028423337a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:40 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45062
I20260812 09:53:40.709177 29357 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb2156e59d94a1eb304028423337a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:40 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:46934
I20260812 09:53:40.709640 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29284
I20260812 09:53:40.709678 29785 tablet_replica.cc:330] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: stopping tablet replica
I20260812 09:53:40.710047 29785 raft_consensus.cc:2229] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:53:40.713757 29783 tablet_replica.cc:330] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: stopping tablet replica
I20260812 09:53:40.714205 29784 tablet_replica.cc:330] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: stopping tablet replica
I20260812 09:53:40.714223 29783 raft_consensus.cc:2229] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:40.714511 29784 raft_consensus.cc:2229] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:53:40.714615 29783 raft_consensus.cc:2258] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:40.714920 29784 raft_consensus.cc:2258] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:53:40.718217 29784 ts_tablet_manager.cc:1905] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:40.718241 29783 ts_tablet_manager.cc:1905] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:53:40.720917 29784 ts_tablet_manager.cc:1918] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:40.721076 29784 log.cc:1196] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/ceb2156e59d94a1eb304028423337a5b
I20260812 09:53:40.721454 29784 ts_tablet_manager.cc:1939] T ceb2156e59d94a1eb304028423337a5b P 84cd3c0699c74f73b9f0924c014088ab: Deleting consensus metadata
I20260812 09:53:40.722263 29783 ts_tablet_manager.cc:1918] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:53:40.722397 29783 log.cc:1196] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/ceb2156e59d94a1eb304028423337a5b
I20260812 09:53:40.722769 29783 ts_tablet_manager.cc:1939] T ceb2156e59d94a1eb304028423337a5b P 7a097bd0298f4921954b73986165700a: Deleting consensus metadata
I20260812 09:53:40.722924 29193 catalog_manager.cc:4841] TS 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): tablet ceb2156e59d94a1eb304028423337a5b (table test-table [id=dda471e92fad4a3bbd327a2e3b08090a]) successfully deleted
W20260812 09:53:40.724342 29193 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:38291 (error 108)
I20260812 09:53:40.724606 29196 catalog_manager.cc:4841] TS 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): tablet ceb2156e59d94a1eb304028423337a5b (table test-table [id=dda471e92fad4a3bbd327a2e3b08090a]) successfully deleted
I20260812 09:53:40.725554 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29434
I20260812 09:53:40.725723 29752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:53:40.725381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38291 (local address 127.0.0.1:46954)
0812 09:53:40.725531 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 09:53:40.725607 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 09:53:40.728294 29193 catalog_manager.cc:4584] TS 4ef060634fab43899a3e157ef582badf (127.11.118.129:38291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ceb2156e59d94a1eb304028423337a5b: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38291: connect: Connection refused (error 111)
I20260812 09:53:40.735280 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29591
I20260812 09:53:40.744144 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29177
I20260812 09:54:00.755177 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--webserver_interface=127.11.118.190
--webserver_port=39509
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:00.972548 29787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:00.973237 29787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:00.973412 29787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:00.980679 29787 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 09:54:00.980813 29787 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 09:54:00.980875 29787 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 09:54:00.980967 29787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:00.981066 29787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:00.981160 29787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:00.981225 29787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:00.981307 29787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:00.990897 29787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:00.993067 29787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:00.994952 29787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:01.020098 29796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:01.019974 29793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:01.019975 29794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:01.020313 29787 server_base.cc:1034] running on GCE node
I20260812 09:54:01.021682 29787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:01.024081 29787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:01.025465 29787 hybrid_clock.cc:648] HybridClock initialized: now 1786528441025425 us; error 79 us; skew 500 ppm
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:01.031764 29787 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:54:01.033738 29787 webserver.cc:460] Webserver started at http://127.11.118.190:39509/ using document root <none> and password file <none>
I20260812 09:54:01.034899 29787 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:01.035133 29787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:01.043498 29787 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 09:54:01.049576 29805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:01.053059 29787 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260812 09:54:01.053380 29787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "95d3ce95de1f48ac97b189b9e37847a6"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "a5dd2d5c61f5ae22a1f332efd69966e7"
server_key_iv: "058e40159438a1177481f4b36a86736c"
server_key_version: "encryptionkey@0"
I20260812 09:54:01.055032 29787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:01.089504 29787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:01.096589 29787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:01.097059 29787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:01.112083 29787 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:42505
I20260812 09:54:01.112592 29866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:42505 every 8 connection(s)
I20260812 09:54:01.114342 29787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:01.123011 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29787
I20260812 09:54:01.124209 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:38291
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=34277
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:54:01.125239 29868 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:54:01.130157 29868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap starting.
I20260812 09:54:01.161404 29868 log.cc:824] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:01.181354 29868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:54:01.182102 29868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap complete.
I20260812 09:54:01.189368 29868 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:01.190129 29868 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Initialized, Role: FOLLOWER
I20260812 09:54:01.191128 29868 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:01.191362 29868 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:01.191537 29868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:01.191721 29868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 09:54:01.195624 29868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:01.196255 29868 leader_election.cc:302] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d3ce95de1f48ac97b189b9e37847a6; no voters:
I20260812 09:54:01.196879 29868 leader_election.cc:288] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 09:54:01.197042 29872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 09:54:01.197423 29872 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 LEADER]: Becoming Leader. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Running, Role: LEADER
I20260812 09:54:01.198033 29872 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:01.199402 29868 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:01.200753 29874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:54:01.201013 29874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:01.202696 29875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d3ce95de1f48ac97b189b9e37847a6. Latest consensus state: current_term: 2 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:54:01.202993 29875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:01.203727 29881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:01.214406 29881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:01.215792 29881 catalog_manager.cc:1259] Loaded cluster ID: 485d6e6af3ee4e32b230bd634d6fd72b
I20260812 09:54:01.215914 29881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:01.220683 29881 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:01.222329 29881 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Loaded TSK: 0
I20260812 09:54:01.246320 29881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Generated new TSK 1
I20260812 09:54:01.246861 29881 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:54:01.352872 29870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:01.353505 29870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:01.353648 29870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:01.360404 29870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:01.360591 29870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:01.360743 29870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:01.370749 29870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=34277
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:01.372745 29870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:01.374616 29870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:01.391933 29898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:01.391933 29897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:01.392001 29900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:01.393715 29870 server_base.cc:1034] running on GCE node
I20260812 09:54:01.394554 29870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:01.395830 29870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:01.397131 29870 hybrid_clock.cc:648] HybridClock initialized: now 1786528441397063 us; error 92 us; skew 500 ppm
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:01.403414 29870 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:54:01.405292 29870 webserver.cc:460] Webserver started at http://127.11.118.129:34277/ using document root <none> and password file <none>
I20260812 09:54:01.406359 29870 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:01.406562 29870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:01.414425 29870 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 09:54:01.418533 29907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:01.421140 29870 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260812 09:54:01.421394 29870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "4ef060634fab43899a3e157ef582badf"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "f2f2d1960c3972a189797033e1ba720e"
server_key_iv: "38751cee39ba5c82b847090c93ad760f"
server_key_version: "encryptionkey@0"
I20260812 09:54:01.422474 29870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:01.462428 29870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:01.469653 29870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:01.470031 29870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:01.471194 29870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:01.473337 29915 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 09:54:01.481719 29870 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 09:54:01.481962 29870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20260812 09:54:01.482123 29870 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 09:54:01.485598 29870 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 09:54:01.485774 29870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260812 09:54:01.486128 29915 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Bootstrap starting.
I20260812 09:54:01.511272 29870 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38291
I20260812 09:54:01.511521 30032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38291 every 8 connection(s)
I20260812 09:54:01.513375 29870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:01.522758 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 29870
I20260812 09:54:01.523942 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:44871
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=35437
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:54:01.524708 29915 log.cc:824] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:01.545719 29915 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:54:01.546838 29915 tablet_bootstrap.cc:492] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Bootstrap complete.
I20260812 09:54:01.549320 29915 ts_tablet_manager.cc:1397] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Time spent bootstrapping tablet: real 0.064s user 0.051s sys 0.007s
I20260812 09:54:01.553063 30035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.517857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:58413 (local address 127.11.118.190:42505)
0812 09:54:01.518942 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:01.519033 (+ 91us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:01.519837 (+ 804us) server_negotiation.cc:407] Connection header received
0812 09:54:01.521900 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:01.521953 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:01.522799 (+ 846us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:01.523596 (+ 797us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:01.528227 (+ 4631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.530367 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.532905 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.533757 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.534152 (+ 395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.538768 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:01.538791 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:01.538823 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:01.538899 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:01.543544 (+ 4645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.545299 (+ 1755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.545310 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.545318 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.545701 (+ 383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.546934 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.546949 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.546953 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.548105 (+ 1152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:01.548379 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:01.550452 (+ 2073us) server_negotiation.cc:299] Negotiation successful
0812 09:54:01.551157 (+ 705us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":270,"threads_started":1}
I20260812 09:54:01.553068 30036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.517807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:58413)
0812 09:54:01.519498 (+ 1691us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:01.519601 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:01.520989 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:01.523853 (+ 2864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:01.523882 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:01.525518 (+ 1636us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:01.527620 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.527685 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.530886 (+ 3201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.530904 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.532584 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.532609 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.534040 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.534057 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.534438 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.535615 (+ 1177us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:01.535647 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:01.538286 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:01.543864 (+ 5578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.543887 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.543925 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.544849 (+ 924us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.546220 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.546225 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.546241 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.546703 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.548371 (+ 1668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:01.548382 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:01.549613 (+ 1231us) client_negotiation.cc:769] Sending connection context
0812 09:54:01.550134 (+ 521us) client_negotiation.cc:240] Negotiation successful
0812 09:54:01.551062 (+ 928us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1327,"thread_start_us":224,"threads_started":1}
I20260812 09:54:01.555109 29915 raft_consensus.cc:348] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:54:01.556573 29915 raft_consensus.cc:729] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Initialized, Role: FOLLOWER
I20260812 09:54:01.557559 29915 consensus_queue.cc:260] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } } peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } }
I20260812 09:54:01.559401 29915 ts_tablet_manager.cc:1428] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260812 09:54:01.560401 30033 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:54:01.560930 30033 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:01.562218 30033 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
I20260812 09:54:01.568073 29824 ts_manager.cc:194] Registered new tserver with Master: 4ef060634fab43899a3e157ef582badf (127.11.118.129:38291)
I20260812 09:54:01.574402 29824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:58413
I20260812 09:54:01.580312 30033 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.129@KRBTEST.COM
I20260812 09:54:01.596282 30040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.574290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38291 (local address 127.0.0.1:43554)
0812 09:54:01.576254 (+ 1964us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:01.576335 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:01.576781 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:01.577855 (+ 1074us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:01.577874 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:01.578769 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:01.579062 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.579085 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.581394 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.581409 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.582684 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.582699 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.583969 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.583974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.584226 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.585788 (+ 1562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:01.585822 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:01.588330 (+ 2508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:01.592248 (+ 3918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.592284 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.592302 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.592821 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.593517 (+ 696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.593521 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.593523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.593671 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.594546 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:01.594553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:01.594801 (+ 248us) client_negotiation.cc:769] Sending connection context
0812 09:54:01.595320 (+ 519us) client_negotiation.cc:240] Negotiation successful
0812 09:54:01.595925 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1625,"thread_start_us":166,"threads_started":1}
I20260812 09:54:01.596256 30041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.574463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43554 (local address 127.11.118.129:38291)
0812 09:54:01.575610 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:01.575642 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:01.576568 (+ 926us) server_negotiation.cc:407] Connection header received
0812 09:54:01.577076 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:01.577083 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:01.577495 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:01.577804 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:01.579350 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.581151 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.583000 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.583720 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.584000 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.588682 (+ 4682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:01.588706 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:01.588720 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:01.588765 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:01.591975 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.593099 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.593108 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.593114 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.593302 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.593929 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.593933 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.593934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.594303 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:01.594560 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:01.595563 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0812 09:54:01.595918 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":959,"thread_start_us":243,"threads_started":1}
I20260812 09:54:01.597903 29955 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb2156e59d94a1eb304028423337a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:53:40 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:43554
I20260812 09:54:01.599149 30043 tablet_replica.cc:330] stopping tablet replica
I20260812 09:54:01.599556 30043 raft_consensus.cc:2229] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:01.599956 30043 raft_consensus.cc:2258] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:01.602130 30043 ts_tablet_manager.cc:1905] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:01.609376 30043 ts_tablet_manager.cc:1918] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:01.609615 30043 log.cc:1196] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal/wals/ceb2156e59d94a1eb304028423337a5b
I20260812 09:54:01.610118 30043 ts_tablet_manager.cc:1939] T ceb2156e59d94a1eb304028423337a5b P 4ef060634fab43899a3e157ef582badf: Deleting consensus metadata
I20260812 09:54:01.613582 29806 catalog_manager.cc:4841] TS 4ef060634fab43899a3e157ef582badf (127.11.118.129:38291): tablet ceb2156e59d94a1eb304028423337a5b (table test-table [id=dda471e92fad4a3bbd327a2e3b08090a]) successfully deleted
W20260812 09:54:01.753562 30038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:01.754084 30038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:01.754158 30038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:01.761013 30038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:01.761158 30038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:01.761260 30038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:01.770179 30038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:44871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=35437
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:01.772111 30038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:01.773785 30038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:01.790238 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:01.790558 30038 server_base.cc:1034] running on GCE node
W20260812 09:54:01.790285 30048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:01.790282 30049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:01.791561 30038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:01.792872 30038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:01.794329 30038 hybrid_clock.cc:648] HybridClock initialized: now 1786528441794277 us; error 73 us; skew 500 ppm
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:01.800549 30038 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:54:01.802469 30038 webserver.cc:460] Webserver started at http://127.11.118.130:35437/ using document root <none> and password file <none>
I20260812 09:54:01.803545 30038 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:01.803752 30038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:01.811651 30038 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 09:54:01.815819 30059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:01.818475 30038 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260812 09:54:01.818838 30038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "84cd3c0699c74f73b9f0924c014088ab"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "3a152b4865e6988de6c408b48c94a1ee"
server_key_iv: "c0d3bbd3267320d07f2de8915c4d3501"
server_key_version: "encryptionkey@0"
I20260812 09:54:01.819988 30038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:01.841763 30038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:01.848845 30038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:01.849190 30038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:01.850384 30038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:01.851953 30038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:01.852105 30038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:01.852273 30038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:01.852348 30038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:01.870747 30038 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:44871
I20260812 09:54:01.870888 30181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:44871 every 8 connection(s)
I20260812 09:54:01.872685 30038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:01.874322 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30038
I20260812 09:54:01.875062 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:36837
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=41271
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 09:54:01 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528441, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:01.901592 30035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.876187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:57829 (local address 127.11.118.190:42505)
0812 09:54:01.876464 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:01.876471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:01.878297 (+ 1826us) server_negotiation.cc:407] Connection header received
0812 09:54:01.880759 (+ 2462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:01.880777 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:01.880891 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:01.881085 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:01.883330 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.884754 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.887044 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.887774 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.888051 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.893396 (+ 5345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:01.893404 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:01.893408 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:01.893482 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:01.897050 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.898091 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.898095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.898098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.898202 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:01.898697 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:01.898700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:01.898702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:01.898996 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:01.899156 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:01.900989 (+ 1833us) server_negotiation.cc:299] Negotiation successful
0812 09:54:01.901300 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 09:54:01.903400 30184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:01.877037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:57829)
0812 09:54:01.877981 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:01.878074 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:01.880323 (+ 2249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:01.881365 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:01.881376 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:01.882064 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:01.882952 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.883066 (+ 114us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.885096 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.885100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.886707 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:01.886731 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:01.888098 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:01.888103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:01.888367 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:01.889583 (+ 1216us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:01.889618 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:01.892943 (+ 3325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:01.897378 (+ 4435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.897395 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.897413 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.897952 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.898384 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:01.898387 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:01.898388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:01.898579 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:01.899249 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:01.899265 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:01.899996 (+ 731us) client_negotiation.cc:769] Sending connection context
0812 09:54:01.900802 (+ 806us) client_negotiation.cc:240] Negotiation successful
0812 09:54:01.901599 (+ 797us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":251,"threads_started":1}
I20260812 09:54:01.905643 30182 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:54:01.906231 30182 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:01.907366 30182 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
I20260812 09:54:01.909637 29824 ts_manager.cc:194] Registered new tserver with Master: 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:54:01.910673 29824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:57829
W20260812 09:54:02.072934 30185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:02.073503 30185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:02.073671 30185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:02.080165 30185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:02.080361 30185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:02.080535 30185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:02.089241 30185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:36837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=41271
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:02.091266 30185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:02.093164 30185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:02.110839 30191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:02.110782 30194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:02.110850 30192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:02.111299 30185 server_base.cc:1034] running on GCE node
I20260812 09:54:02.111961 30185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:02.113581 30185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:02.115049 30185 hybrid_clock.cc:648] HybridClock initialized: now 1786528442114949 us; error 112 us; skew 500 ppm
Aug 12 09:54:02 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528442, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:02.121876 30185 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:54:02.123740 30185 webserver.cc:460] Webserver started at http://127.11.118.131:41271/ using document root <none> and password file <none>
I20260812 09:54:02.124789 30185 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:02.125000 30185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:02.132970 30185 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 09:54:02.136951 30201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:02.139665 30185 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260812 09:54:02.139927 30185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "7a097bd0298f4921954b73986165700a"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "798724ef457db55652f0a47ac1bba1fd"
server_key_iv: "a6483bba6715f4bc8fb802dc0fa27089"
server_key_version: "encryptionkey@0"
I20260812 09:54:02.140801 30185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:02.160296 30185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:02.167073 30185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:02.167526 30185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:02.168601 30185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:02.170109 30185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:02.170233 30185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:02.170351 30185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:02.170430 30185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:02.187198 30185 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:36837
I20260812 09:54:02.187233 30328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:36837 every 8 connection(s)
I20260812 09:54:02.189006 30185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:02.190953 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30185
I20260812 09:54:02.209474 30035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.192348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.11.118.190:42505)
0812 09:54:02.192609 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.192627 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.193035 (+ 408us) server_negotiation.cc:407] Connection header received
0812 09:54:02.193341 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.193346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.193434 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.193604 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:02.195672 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.196984 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.198605 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.199344 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.199619 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.202540 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:02.202544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:02.202555 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:02.202597 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:02.205816 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.207051 (+ 1235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.207055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.207057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.207279 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.207813 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.207817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.207818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.208243 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:02.208587 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.208905 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.209186 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"spinlock_wait_cycles":4352}
Aug 12 09:54:02 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528442, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:02.219980 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.192398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:58145 (local address 127.11.118.190:42505)
0812 09:54:02.196560 (+ 4162us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.196573 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.196589 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:54:02.198088 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.198093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.198198 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.198395 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:02.201772 (+ 3377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.202870 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.206120 (+ 3250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.206800 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.207043 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.212500 (+ 5457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:02.212507 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:02.212520 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:02.212581 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:02.215547 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.216784 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.216788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.216790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.216956 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.217691 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.217694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.217696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.218131 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:02.218301 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.219455 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.219741 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4062,"spinlock_wait_cycles":7936,"thread_start_us":211,"threads_started":1}
I20260812 09:54:02.221463 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.193511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:58145)
0812 09:54:02.195899 (+ 2388us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.196110 (+ 211us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:02.197718 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:02.198774 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:02.198785 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:02.200083 (+ 1298us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:02.201442 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.201484 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.203185 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.203192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.205858 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.205906 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.207182 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.207192 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.207635 (+ 443us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.208717 (+ 1082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:02.208788 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:02.212165 (+ 3377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:02.215828 (+ 3663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:02.215840 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:02.215873 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:02.216496 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:02.217160 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:02.217163 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:02.217176 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:02.217486 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:02.218337 (+ 851us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:02.218353 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:02.218918 (+ 565us) client_negotiation.cc:769] Sending connection context
0812 09:54:02.219334 (+ 416us) client_negotiation.cc:240] Negotiation successful
0812 09:54:02.219851 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1836,"thread_start_us":1539,"threads_started":1}
I20260812 09:54:02.223747 30329 heartbeater.cc:347] Connected to a master server at 127.11.118.190:42505
I20260812 09:54:02.224210 30329 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:02.225133 30329 heartbeater.cc:511] Master 127.11.118.190:42505 requested a full tablet report, sending...
I20260812 09:54:02.226768 29824 ts_manager.cc:194] Registered new tserver with Master: 7a097bd0298f4921954b73986165700a (127.11.118.131:36837)
I20260812 09:54:02.227784 29824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:58145
I20260812 09:54:02.239812 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:02.248711 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.240993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.11.118.190:42505)
0812 09:54:02.241276 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.241308 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.241598 (+ 290us) server_negotiation.cc:407] Connection header received
0812 09:54:02.242033 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.242037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.242228 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.242522 (+ 294us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:02.242937 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.243955 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.245870 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.246505 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.246784 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.247502 (+ 718us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:02.247846 (+ 344us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 09:54:02.248447 (+ 601us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54754: token expired
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 09:54:02.248852 30332 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54754: token expired
W20260812 09:54:02.249522 29745 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.118.190:42505)
I20260812 09:54:02.263720 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.250167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54764 (local address 127.11.118.190:42505)
0812 09:54:02.250401 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.250408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.250435 (+ 27us) server_negotiation.cc:407] Connection header received
0812 09:54:02.250672 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.250676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.250748 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.250887 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:02.252083 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.252895 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.254168 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.254543 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.254763 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.257383 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:02.257389 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:02.257391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:02.257449 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:02.260335 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.261253 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.261258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.261260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.261433 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:02.261978 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:02.261991 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:02.261993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:02.262338 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:02.262615 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.263137 (+ 522us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.263371 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 09:54:02.268581 29824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:02.274047 29824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:02.289304 29955 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6d9b7936f45478fc774c1c2a944f8 (DEFAULT_TABLE table=test-table [id=b1f83c3ff3ac4fd88eb237c875dbfacb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:02.290652 29955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6d9b7936f45478fc774c1c2a944f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:02.295087 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.286778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:36837 (local address 127.0.0.1:45364)
0812 09:54:02.287404 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.287435 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:02.287639 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:02.289081 (+ 1442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:02.289083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:02.289100 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:02.289235 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.289250 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.291087 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.291091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.292645 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.292656 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.294191 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.294196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.294374 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.294489 (+ 115us) client_negotiation.cc:769] Sending connection context
0812 09:54:02.294596 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 09:54:02.294764 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":244,"threads_started":1}
I20260812 09:54:02.296623 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.287091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.11.118.131:36837)
0812 09:54:02.287668 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.287698 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.287750 (+ 52us) server_negotiation.cc:407] Connection header received
0812 09:54:02.288208 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.288217 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.288567 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.288788 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:02.289457 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.290835 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.292892 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.293903 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.295673 (+ 1770us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.296034 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.296135 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.296351 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":218,"threads_started":1}
I20260812 09:54:02.297605 30344 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Bootstrap starting.
I20260812 09:54:02.299647 30344 tablet_bootstrap.cc:654] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:02.301410 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.288019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33898 (local address 127.11.118.130:44871)
0812 09:54:02.288785 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.288802 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.288851 (+ 49us) server_negotiation.cc:407] Connection header received
0812 09:54:02.288983 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.288998 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.289507 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.289984 (+ 477us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:02.291058 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.293220 (+ 2162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.297826 (+ 4606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.300287 (+ 2461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.300552 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.300884 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.301013 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.301188 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":198,"threads_started":1}
I20260812 09:54:02.301395 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.287364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.0.0.1:33898)
0812 09:54:02.288005 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.288031 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:02.288195 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:02.290364 (+ 2169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:02.290378 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:02.290414 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:02.290626 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.290646 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.293550 (+ 2904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.293557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.296532 (+ 2975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.296600 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.300572 (+ 3972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.300579 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.300777 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.300803 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 09:54:02.300952 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 09:54:02.301133 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":179,"threads_started":1}
I20260812 09:54:02.302256 30344 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: No bootstrap required, opened a new log
I20260812 09:54:02.302516 30344 ts_tablet_manager.cc:1397] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 09:54:02.303395 30344 raft_consensus.cc:348] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.303663 30344 raft_consensus.cc:374] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:02.303782 30344 raft_consensus.cc:729] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Initialized, Role: FOLLOWER
I20260812 09:54:02.304034 30344 consensus_queue.cc:260] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.303223 30257 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6d9b7936f45478fc774c1c2a944f8 (DEFAULT_TABLE table=test-table [id=b1f83c3ff3ac4fd88eb237c875dbfacb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:02.304687 30344 ts_tablet_manager.cc:1428] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 09:54:02.305284 30257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6d9b7936f45478fc774c1c2a944f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:02.307318 30111 tablet_service.cc:1467] Processing CreateTablet for tablet 57b6d9b7936f45478fc774c1c2a944f8 (DEFAULT_TABLE table=test-table [id=b1f83c3ff3ac4fd88eb237c875dbfacb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:02.309502 30111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57b6d9b7936f45478fc774c1c2a944f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:02.319749 30347 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Bootstrap starting.
I20260812 09:54:02.322077 30348 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Bootstrap starting.
I20260812 09:54:02.325103 30347 tablet_bootstrap.cc:654] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:02.326552 30348 tablet_bootstrap.cc:654] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:02.326774 30347 log.cc:824] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:02.328686 30348 log.cc:824] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:02.331221 30347 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: No bootstrap required, opened a new log
I20260812 09:54:02.331607 30347 ts_tablet_manager.cc:1397] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260812 09:54:02.332448 30348 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: No bootstrap required, opened a new log
I20260812 09:54:02.332741 30348 ts_tablet_manager.cc:1397] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260812 09:54:02.339627 30347 raft_consensus.cc:348] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.339627 30348 raft_consensus.cc:348] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.340339 30348 raft_consensus.cc:374] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:02.340507 30348 raft_consensus.cc:729] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84cd3c0699c74f73b9f0924c014088ab, State: Initialized, Role: FOLLOWER
I20260812 09:54:02.340339 30347 raft_consensus.cc:374] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:02.340979 30347 raft_consensus.cc:729] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a097bd0298f4921954b73986165700a, State: Initialized, Role: FOLLOWER
I20260812 09:54:02.341511 30348 consensus_queue.cc:260] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.341590 30347 consensus_queue.cc:260] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.342904 30182 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
I20260812 09:54:02.343312 30329 heartbeater.cc:503] Master 127.11.118.190:42505 was elected leader, sending a full tablet report...
I20260812 09:54:02.343835 30348 ts_tablet_manager.cc:1428] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260812 09:54:02.343835 30347 ts_tablet_manager.cc:1428] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
W20260812 09:54:02.375926 30183 tablet.cc:2369] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:54:02.440886 30330 tablet.cc:2369] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:54:02.518399 30034 tablet.cc:2369] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:54:02.561899 30346 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:02.562259 30346 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.564379 30346 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:54:02.571259 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.565036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:45285 (local address 127.11.118.130:44871)
0812 09:54:02.565337 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.565342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.565850 (+ 508us) server_negotiation.cc:407] Connection header received
0812 09:54:02.566062 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.566067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.566134 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.566256 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:02.566706 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.567516 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.569549 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.570206 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.570464 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.570586 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.570911 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.571036 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260812 09:54:02.571286 30353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.564658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:36837 (local address 127.11.118.129:56115)
0812 09:54:02.565466 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.565497 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:02.565728 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:02.566319 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:02.566322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:02.566351 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:02.566569 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.566576 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.567718 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.567722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.569286 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.569319 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.570464 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.570469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.570692 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.570755 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 09:54:02.570916 (+ 161us) client_negotiation.cc:240] Negotiation successful
0812 09:54:02.571041 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":107,"thread_start_us":182,"threads_started":1}
I20260812 09:54:02.571273 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.565059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:56115 (local address 127.11.118.131:36837)
0812 09:54:02.565273 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.565280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.565677 (+ 397us) server_negotiation.cc:407] Connection header received
0812 09:54:02.566079 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.566081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.566141 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.566294 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:02.566753 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.567515 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.569546 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.570220 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.570488 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.570598 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.570944 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.571059 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:54:02.571290 30354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.564839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.11.118.129:45285)
0812 09:54:02.565601 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.565663 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:02.565866 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:02.566280 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:02.566286 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:02.566319 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:02.566550 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.566564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.567706 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.567712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.569300 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:02.569322 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.570460 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.570466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:02.570701 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.570750 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 09:54:02.570890 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 09:54:02.571042 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":254,"spinlock_wait_cycles":2432,"thread_start_us":387,"threads_started":1}
I20260812 09:54:02.572613 30278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6d9b7936f45478fc774c1c2a944f8" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a097bd0298f4921954b73986165700a" is_pre_election: true
I20260812 09:54:02.572803 30133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6d9b7936f45478fc774c1c2a944f8" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84cd3c0699c74f73b9f0924c014088ab" is_pre_election: true
I20260812 09:54:02.573196 30278 raft_consensus.cc:2454] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 0.
I20260812 09:54:02.573277 30133 raft_consensus.cc:2454] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 0.
I20260812 09:54:02.574787 29910 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4ef060634fab43899a3e157ef582badf, 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab; no voters:
I20260812 09:54:02.575598 30346 raft_consensus.cc:2781] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:02.575892 30346 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:02.576102 30346 raft_consensus.cc:3037] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:02.578611 30346 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.579275 30346 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 election: Requested vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
I20260812 09:54:02.580034 30133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6d9b7936f45478fc774c1c2a944f8" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84cd3c0699c74f73b9f0924c014088ab"
I20260812 09:54:02.580179 30278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57b6d9b7936f45478fc774c1c2a944f8" candidate_uuid: "4ef060634fab43899a3e157ef582badf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a097bd0298f4921954b73986165700a"
I20260812 09:54:02.580274 30133 raft_consensus.cc:3037] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:02.580467 30278 raft_consensus.cc:3037] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:02.582392 30133 raft_consensus.cc:2454] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 1.
I20260812 09:54:02.582465 30278 raft_consensus.cc:2454] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef060634fab43899a3e157ef582badf in term 1.
I20260812 09:54:02.583221 29908 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef060634fab43899a3e157ef582badf, 84cd3c0699c74f73b9f0924c014088ab; no voters:
I20260812 09:54:02.583570 30346 raft_consensus.cc:2781] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:02.583982 30346 raft_consensus.cc:686] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 LEADER]: Becoming Leader. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Running, Role: LEADER
I20260812 09:54:02.584450 30346 consensus_queue.cc:237] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:02.590061 29822 catalog_manager.cc:5495] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef060634fab43899a3e157ef582badf (127.11.118.129). New cstate: current_term: 1 leader_uuid: "4ef060634fab43899a3e157ef582badf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } health_report { overall_health: HEALTHY } } }
I20260812 09:54:02.608971 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.602427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.11.118.129:38291)
0812 09:54:02.603106 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:02.603138 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:02.603161 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:54:02.603288 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:02.603294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:02.603409 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:02.603598 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:02.603968 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.604791 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.606124 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:02.606542 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:02.606793 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:02.607336 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:02.608117 (+ 781us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:02.608376 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:02.608511 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 09:54:02.608625 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":229,"threads_started":1}
I20260812 09:54:02.616266 30133 raft_consensus.cc:1261] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Refusing update from remote peer 4ef060634fab43899a3e157ef582badf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:02.616266 30278 raft_consensus.cc:1261] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Refusing update from remote peer 4ef060634fab43899a3e157ef582badf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:02.617779 30355 consensus_queue.cc:1035] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:02.618162 30346 consensus_queue.cc:1035] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [LEADER]: Connected to new peer: Peer: permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:02.632115 30358 mvcc.cc:205] Tried to move back new op lower bound from 7317620500945039360 to 7317620500831313920. Current Snapshot: MvccSnapshot[applied={T|T < 7317620500945039360}]
I20260812 09:54:02.635548 30361 mvcc.cc:205] Tried to move back new op lower bound from 7317620500945039360 to 7317620500831313920. Current Snapshot: MvccSnapshot[applied={T|T < 7317620500945039360}]
I20260812 09:54:02.649531 29824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:02.649911 29824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:02.654114 29824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Sending DeleteTablet for 3 replicas of tablet 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:02.655592 30111 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b6d9b7936f45478fc774c1c2a944f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:02 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:33898
I20260812 09:54:02.656649 30257 tablet_service.cc:1514] Processing DeleteTablet for tablet 57b6d9b7936f45478fc774c1c2a944f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:02 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45364
I20260812 09:54:02.657194 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29870
I20260812 09:54:02.657611 30372 tablet_replica.cc:330] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: stopping tablet replica
I20260812 09:54:02.665603 30372 raft_consensus.cc:2229] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:02.666081 30374 tablet_replica.cc:330] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: stopping tablet replica
I20260812 09:54:02.666472 30372 raft_consensus.cc:2258] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:02.666826 30374 raft_consensus.cc:2229] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:02.667311 30374 raft_consensus.cc:2258] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:02.669430 30374 ts_tablet_manager.cc:1905] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:02.669579 30372 ts_tablet_manager.cc:1905] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:02.673596 30374 ts_tablet_manager.cc:1918] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:02.673836 30374 log.cc:1196] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:02.674430 30374 ts_tablet_manager.cc:1939] T 57b6d9b7936f45478fc774c1c2a944f8 P 7a097bd0298f4921954b73986165700a: Deleting consensus metadata
I20260812 09:54:02.676640 30372 ts_tablet_manager.cc:1918] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:02.676875 30372 log.cc:1196] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:02.677477 29808 catalog_manager.cc:4841] TS 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): tablet 57b6d9b7936f45478fc774c1c2a944f8 (table test-table [id=b1f83c3ff3ac4fd88eb237c875dbfacb]) successfully deleted
I20260812 09:54:02.677570 30372 ts_tablet_manager.cc:1939] T 57b6d9b7936f45478fc774c1c2a944f8 P 84cd3c0699c74f73b9f0924c014088ab: Deleting consensus metadata
W20260812 09:54:02.678300 29806 connection.cc:535] client connection to 127.11.118.129:38291 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 09:54:02.678578 29806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 09:54:02.679098 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 30038
I20260812 09:54:02.682821 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.682251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:38291 (local address 127.0.0.1:43572)
0812 09:54:02.682524 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.682662 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260812 09:54:02.683346 29806 catalog_manager.cc:4584] TS 4ef060634fab43899a3e157ef582badf (127.11.118.129:38291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 57b6d9b7936f45478fc774c1c2a944f8: Network error: Client connection negotiation failed: client connection to 127.11.118.129:38291: connect: Connection refused (error 111)
I20260812 09:54:02.693697 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 30185
I20260812 09:54:02.694830 30342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:02.694112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.0.0.1:33904)
0812 09:54:02.694505 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:02.694651 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.130:44871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228}
I20260812 09:54:02.711439 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 29787
I20260812 09:54:22.727578 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--webserver_interface=127.11.118.190
--webserver_port=39509
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:22.852370 30376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:22.852726 30376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:22.852809 30376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:22.857088 30376 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 09:54:22.857188 30376 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 09:54:22.857213 30376 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 09:54:22.857236 30376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:22.857280 30376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:22.857317 30376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:22.857376 30376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:22.857417 30376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:22.863245 30376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:22.864467 30376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:22.865563 30376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:22.875064 30388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:22.875006 30384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:22.875072 30385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:22.875131 30376 server_base.cc:1034] running on GCE node
I20260812 09:54:22.875962 30376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:22.877288 30376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:22.878518 30376 hybrid_clock.cc:648] HybridClock initialized: now 1786528462878490 us; error 44 us; skew 500 ppm
Aug 12 09:54:22 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:22.881642 30376 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:54:22.882735 30376 webserver.cc:460] Webserver started at http://127.11.118.190:39509/ using document root <none> and password file <none>
I20260812 09:54:22.883435 30376 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:22.883549 30376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:22.888659 30376 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:22.891494 30398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:22.893019 30376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:22.893209 30376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "95d3ce95de1f48ac97b189b9e37847a6"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "a5dd2d5c61f5ae22a1f332efd69966e7"
server_key_iv: "058e40159438a1177481f4b36a86736c"
server_key_version: "encryptionkey@0"
I20260812 09:54:22.893851 30376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:22.912894 30376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:22.916824 30376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:22.917119 30376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:22.925941 30376 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:42505
I20260812 09:54:22.926258 30458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:42505 every 8 connection(s)
I20260812 09:54:22.927364 30376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:22.932139 30459 sys_catalog.cc:263] Verifying existing consensus state
I20260812 09:54:22.933955 30459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap starting.
I20260812 09:54:22.937682 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30376
I20260812 09:54:22.938228 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:38291
--local_ip_for_outbound_sockets=127.11.118.129
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=34277
--webserver_interface=127.11.118.129
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:54:22.958237 30459 log.cc:824] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:22.973834 30459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:54:22.974385 30459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Bootstrap complete.
I20260812 09:54:22.980223 30459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:22.980752 30459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Initialized, Role: FOLLOWER
I20260812 09:54:22.981328 30459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:22.981492 30459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:22.981560 30459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:22.981662 30459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 09:54:22.984552 30459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:22.984972 30459 leader_election.cc:302] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d3ce95de1f48ac97b189b9e37847a6; no voters:
I20260812 09:54:22.985359 30459 leader_election.cc:288] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 09:54:22.985559 30464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 09:54:22.985846 30464 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [term 3 LEADER]: Becoming Leader. State: Replica: 95d3ce95de1f48ac97b189b9e37847a6, State: Running, Role: LEADER
I20260812 09:54:22.986198 30464 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } }
I20260812 09:54:22.986732 30459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:22.987902 30466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:54:22.987877 30467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d3ce95de1f48ac97b189b9e37847a6. Latest consensus state: current_term: 3 leader_uuid: "95d3ce95de1f48ac97b189b9e37847a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3ce95de1f48ac97b189b9e37847a6" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42505 } } }
I20260812 09:54:22.988022 30466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:22.988022 30467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:22.988441 30474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:22.993825 30474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:22.994801 30474 catalog_manager.cc:1259] Loaded cluster ID: 485d6e6af3ee4e32b230bd634d6fd72b
I20260812 09:54:22.994884 30474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:22.997587 30474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:22.998457 30474 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Loaded TSK: 0
I20260812 09:54:22.998549 30474 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 95d3ce95de1f48ac97b189b9e37847a6: Loaded TSK: 1
F20260812 09:54:23.000028 30474 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f19b49a49ad google::LogMessage::Fail() at ??:0
@ 0x7f19b49a788a google::LogMessage::SendToLog() at ??:0
@ 0x7f19b49a44de google::LogMessage::Flush() at ??:0
@ 0x7f19b49a5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f19b766818d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f19b7660f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f19bf3097bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f19bf2e399c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f19bf2e4178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f19bf325df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f19bf34482b std::function<>::operator()() at ??:0
@ 0x7f19bf2e3b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f19bf2e4f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f19bf2e1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f19bf325640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f19b6bf63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f19b6bf6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f19b6bf83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f19b6be7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f19b822b6db start_thread at ??:0
@ 0x7f19b34a261f clone at ??:0
W20260812 09:54:23.129443 30462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:23.129820 30462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:23.129918 30462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:23.136459 30462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:23.136529 30462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:23.136623 30462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:23.142307 30462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=34277
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:23.143504 30462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:23.144538 30462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:23.154626 30515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:23.154773 30518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:23.154635 30514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:23.155122 30462 server_base.cc:1034] running on GCE node
I20260812 09:54:23.155570 30462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:23.156257 30462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:23.157469 30462 hybrid_clock.cc:648] HybridClock initialized: now 1786528463157439 us; error 43 us; skew 500 ppm
Aug 12 09:54:23 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:23.160766 30462 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:54:23.161825 30462 webserver.cc:460] Webserver started at http://127.11.118.129:34277/ using document root <none> and password file <none>
I20260812 09:54:23.162459 30462 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:23.162564 30462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:23.167376 30462 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:23.169924 30525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.171569 30462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:23.171742 30462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "4ef060634fab43899a3e157ef582badf"
format_stamp: "Formatted at 2026-08-12 09:53:39 on dist-test-slave-2w3w"
server_key: "f2f2d1960c3972a189797033e1ba720e"
server_key_iv: "38751cee39ba5c82b847090c93ad760f"
server_key_version: "encryptionkey@0"
I20260812 09:54:23.172343 30462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:23.202126 30462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:23.206058 30462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:23.206297 30462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:23.207047 30462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:23.208274 30535 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 09:54:23.214094 30462 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 09:54:23.214198 30462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260812 09:54:23.214290 30462 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 09:54:23.216208 30462 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 09:54:23.216284 30462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260812 09:54:23.216586 30535 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Bootstrap starting.
I20260812 09:54:23.227718 30462 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:38291
I20260812 09:54:23.228016 30657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:38291 every 8 connection(s)
I20260812 09:54:23.228879 30462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:23.232002 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30462
I20260812 09:54:23.232544 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:44871
--local_ip_for_outbound_sockets=127.11.118.130
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=35437
--webserver_interface=127.11.118.130
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:54:23.243214 30535 log.cc:824] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:23.252007 30535 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 09:54:23.252470 30535 tablet_bootstrap.cc:492] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Bootstrap complete.
I20260812 09:54:23.253774 30535 ts_tablet_manager.cc:1397] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Time spent bootstrapping tablet: real 0.037s user 0.027s sys 0.004s
I20260812 09:54:23.256562 30535 raft_consensus.cc:348] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:23.257121 30535 raft_consensus.cc:729] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef060634fab43899a3e157ef582badf, State: Initialized, Role: FOLLOWER
I20260812 09:54:23.257688 30535 consensus_queue.cc:260] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:23.258687 30535 ts_tablet_manager.cc:1428] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
W20260812 09:54:23.290895 30660 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:54:23.231138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:36297)
0812 09:54:23.232243 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.232318 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:23.233895 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:23.290081 (+ 56186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":175,"threads_started":1}
W20260812 09:54:23.291874 30658 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:42505 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:42505: Client connection negotiation failed: client connection to 127.11.118.190:42505: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 09:54:23.292936 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.292526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:59359)
0812 09:54:23.292769 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.292863 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260812 09:54:23.293731 30660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.293498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:43521)
0812 09:54:23.293612 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.293666 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 09:54:23.293994 30658 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:54:23.374282 30662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:23.374665 30662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:23.374826 30662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:23.379104 30662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:23.379173 30662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:23.379271 30662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:23.384896 30662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:44871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=35437
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:23.386039 30662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:23.387121 30662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:23.397763 30672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:23.397886 30670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:23.397780 30669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:23.397877 30662 server_base.cc:1034] running on GCE node
I20260812 09:54:23.398518 30662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:23.399340 30662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:23.400542 30662 hybrid_clock.cc:648] HybridClock initialized: now 1786528463400506 us; error 51 us; skew 500 ppm
Aug 12 09:54:23 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:23.403839 30662 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:54:23.405015 30662 webserver.cc:460] Webserver started at http://127.11.118.130:35437/ using document root <none> and password file <none>
I20260812 09:54:23.405642 30662 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:23.405743 30662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:23.410039 30662 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:54:23.412420 30680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.413650 30662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260812 09:54:23.413832 30662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "84cd3c0699c74f73b9f0924c014088ab"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "3a152b4865e6988de6c408b48c94a1ee"
server_key_iv: "c0d3bbd3267320d07f2de8915c4d3501"
server_key_version: "encryptionkey@0"
I20260812 09:54:23.414422 30662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:23.447806 30662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:23.451156 30662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:23.451390 30662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:23.452045 30662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:23.452919 30662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:23.452991 30662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.453064 30662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:23.453112 30662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.463232 30662 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:44871
I20260812 09:54:23.463259 30808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:44871 every 8 connection(s)
I20260812 09:54:23.464329 30662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:23.466514 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30662
I20260812 09:54:23.467078 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:36837
--local_ip_for_outbound_sockets=127.11.118.131
--tserver_master_addrs=127.11.118.190:42505
--webserver_port=41271
--webserver_interface=127.11.118.131
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:54:23.468683 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.466627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:55569)
0812 09:54:23.467813 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.467937 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":968,"thread_start_us":793,"threads_started":1}
W20260812 09:54:23.469267 30811 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:42505 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:42505: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
I20260812 09:54:23.470043 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.469773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:40057)
0812 09:54:23.469897 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.469962 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 09:54:23.471031 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.470698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:42461)
0812 09:54:23.470880 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.470933 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260812 09:54:23.471302 30811 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 09:54:23.587136 30814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:23.587430 30814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:23.587507 30814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:23.593009 30814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:23.593083 30814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:23.593178 30814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:23.599124 30814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:36837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=41271
--tserver_master_addrs=127.11.118.190:42505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:23.600242 30814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:23.601329 30814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:23.612237 30819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:23.612244 30820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:23.612550 30814 server_base.cc:1034] running on GCE node
W20260812 09:54:23.612215 30822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:23.613009 30814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:23.613720 30814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:23.614926 30814 hybrid_clock.cc:648] HybridClock initialized: now 1786528463614895 us; error 45 us; skew 500 ppm
Aug 12 09:54:23 dist-test-slave-2w3w krb5kdc[29161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:23.618036 30814 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:54:23.619143 30814 webserver.cc:460] Webserver started at http://127.11.118.131:41271/ using document root <none> and password file <none>
I20260812 09:54:23.619720 30814 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:23.619786 30814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:23.623886 30814 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:54:23.626032 30830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.627431 30814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260812 09:54:23.627562 30814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "7a097bd0298f4921954b73986165700a"
format_stamp: "Formatted at 2026-08-12 09:53:40 on dist-test-slave-2w3w"
server_key: "798724ef457db55652f0a47ac1bba1fd"
server_key_iv: "a6483bba6715f4bc8fb802dc0fa27089"
server_key_version: "encryptionkey@0"
I20260812 09:54:23.628171 30814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:23.641688 30814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:23.645562 30814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:23.645797 30814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:23.646574 30814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:23.647603 30814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:23.647665 30814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.647737 30814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:23.647778 30814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:23.657722 30814 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:36837
I20260812 09:54:23.657744 30963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:36837 every 8 connection(s)
I20260812 09:54:23.658828 30814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:23.662906 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.661120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:36887)
0812 09:54:23.661643 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.662132 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":130,"threads_started":1}
W20260812 09:54:23.663440 30964 heartbeater.cc:644] Failed to heartbeat to 127.11.118.190:42505 (0 consecutive failures): Network error: Failed to ping master at 127.11.118.190:42505: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
I20260812 09:54:23.664165 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.663912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:40133)
0812 09:54:23.664039 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.664105 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 09:54:23.664896 30966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:23.664640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:55377)
0812 09:54:23.664782 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:23.664840 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260812 09:54:23.665220 30964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 09:54:23.666517 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 30814
I20260812 09:54:24.295228 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.294659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:51435)
0812 09:54:24.295045 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:24.295111 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":102,"threads_started":1}
I20260812 09:54:24.472393 30969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.471893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:34511)
0812 09:54:24.472193 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:24.472255 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":112,"threads_started":1}
I20260812 09:54:24.474546 30971 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:24.474789 30971 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:24.476049 30971 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
Aug 12 09:54:24 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.130@KRBTEST.COM
Aug 12 09:54:24 dist-test-slave-2w3w krb5kdc[29161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.131@KRBTEST.COM
I20260812 09:54:24.491437 30972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.476282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:44871 (local address 127.11.118.129:54313)
0812 09:54:24.476843 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:24.476856 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:24.476993 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:24.479239 (+ 2246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:24.479244 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:24.479432 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:24.479882 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:24.479903 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.481450 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.481453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:24.482504 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:24.482519 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.483420 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.483424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:24.483641 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:24.484405 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:24.484423 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:24.486270 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:24.488903 (+ 2633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:24.488910 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:24.488923 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:24.489196 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:24.489588 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:24.489593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:24.489740 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:24.490452 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:24.490458 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:24.490685 (+ 227us) client_negotiation.cc:769] Sending connection context
0812 09:54:24.490876 (+ 191us) client_negotiation.cc:240] Negotiation successful
0812 09:54:24.491241 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":189,"thread_start_us":85,"threads_started":1}
I20260812 09:54:24.491488 30973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.476478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54313 (local address 127.11.118.130:44871)
0812 09:54:24.476818 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:24.476847 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:24.476955 (+ 108us) server_negotiation.cc:407] Connection header received
0812 09:54:24.477910 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:24.477916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:24.478368 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:24.478711 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:24.480088 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.481247 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.482673 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.483252 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.483453 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:24.486610 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:24.486616 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:24.486630 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:24.486668 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:24.488752 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489340 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:24.489345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:24.489348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:24.489478 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489846 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:24.489849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:24.489851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:24.490315 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:24.490464 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:24.491035 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 09:54:24.491321 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":106,"threads_started":1}
I20260812 09:54:24.492450 30975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.476510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54301 (local address 127.11.118.131:36837)
0812 09:54:24.476934 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:24.476945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:24.476986 (+ 41us) server_negotiation.cc:407] Connection header received
0812 09:54:24.477902 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:24.477911 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:24.478368 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:24.478711 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:24.480123 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.481263 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.482646 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.483248 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.483436 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:24.487060 (+ 3624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:24.487067 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:24.487083 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:24.487126 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:24.489165 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489694 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:24.489700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:24.489705 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:24.489836 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:24.490165 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:24.490170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:24.490172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:24.490634 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:24.490767 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:24.491901 (+ 1134us) server_negotiation.cc:299] Negotiation successful
0812 09:54:24.492218 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":93,"threads_started":1}
I20260812 09:54:24.492803 30968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.476279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:36837 (local address 127.11.118.129:54301)
0812 09:54:24.476407 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:24.476425 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:24.476546 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:24.478833 (+ 2287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:24.478838 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:24.479369 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:24.479883 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:24.479901 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.481451 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.481459 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:24.482499 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:24.482511 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:24.483400 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:24.483404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:24.483639 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:24.484449 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:24.484462 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:24.486713 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:24.489315 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:24.489320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:24.489562 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:24.489956 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:24.489961 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:24.489963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:24.490060 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:24.490834 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:24.490840 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:24.490995 (+ 155us) client_negotiation.cc:769] Sending connection context
0812 09:54:24.491112 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 09:54:24.492505 (+ 1393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":151,"spinlock_wait_cycles":17280}
W20260812 09:54:24.494114 30527 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
W20260812 09:54:24.494910 30529 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:24.495074 30529 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef060634fab43899a3e157ef582badf; no voters: 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab
I20260812 09:54:24.495326 30971 raft_consensus.cc:2726] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:54:24.666391 30976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:24.665890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:33231)
0812 09:54:24.666209 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:24.666272 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":74,"threads_started":1}
I20260812 09:54:25.296540 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:25.296055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:44269)
0812 09:54:25.296355 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:25.296418 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":86,"threads_started":1}
I20260812 09:54:25.473629 30978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:25.473146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:56445)
0812 09:54:25.473447 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:25.473515 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":88,"threads_started":1}
I20260812 09:54:25.667704 30979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:25.667223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:56839)
0812 09:54:25.667511 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:25.667573 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":78,"threads_started":1}
I20260812 09:54:26.078423 30980 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:26.078559 30980 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:26.079139 30980 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
W20260812 09:54:26.080206 30529 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
W20260812 09:54:26.080328 30527 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:26.080453 30527 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef060634fab43899a3e157ef582badf; no voters: 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab
I20260812 09:54:26.080634 30980 raft_consensus.cc:2726] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:54:26.298177 30981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:26.297681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:58435)
0812 09:54:26.297974 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:26.298043 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":125,"threads_started":1}
I20260812 09:54:26.475032 30982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:26.474490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:41933)
0812 09:54:26.474770 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:26.474867 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":74,"threads_started":1}
I20260812 09:54:26.669169 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:26.668603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:52829)
0812 09:54:26.668926 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:26.668991 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":96,"threads_started":1}
I20260812 09:54:27.299674 30985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:27.299202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:33127)
0812 09:54:27.299497 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:27.299562 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":86,"threads_started":1}
I20260812 09:54:27.476411 30986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:27.475902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:43579)
0812 09:54:27.476239 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:27.476310 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":128,"threads_started":1}
I20260812 09:54:27.670735 30987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:27.670183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:34609)
0812 09:54:27.670541 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:27.670621 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":86,"threads_started":1}
I20260812 09:54:28.301213 30988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:28.300670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:58379)
0812 09:54:28.301037 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:28.301114 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":85,"threads_started":1}
I20260812 09:54:28.477969 30990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:28.477467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:47887)
0812 09:54:28.477759 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:28.477825 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":108,"threads_started":1}
I20260812 09:54:28.563848 30991 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:28.564016 30991 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:28.564484 30991 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
W20260812 09:54:28.565367 30527 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
W20260812 09:54:28.565507 30529 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:28.565627 30529 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef060634fab43899a3e157ef582badf; no voters: 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab
I20260812 09:54:28.565850 30991 raft_consensus.cc:2726] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:54:28.672115 30992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:28.671675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:48439)
0812 09:54:28.671954 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:28.672017 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260812 09:54:29.302525 30993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:29.302064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:36561)
0812 09:54:29.302363 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:29.302425 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":80,"threads_started":1}
I20260812 09:54:29.479328 30994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:29.478857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:45381)
0812 09:54:29.479168 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:29.479229 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":131,"threads_started":1}
I20260812 09:54:29.673538 30995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:29.673054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:40233)
0812 09:54:29.673359 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:29.673435 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":89,"threads_started":1}
I20260812 09:54:30.304032 30996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:30.303480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:58205)
0812 09:54:30.303830 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:30.303912 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":112,"threads_started":1}
I20260812 09:54:30.480602 30997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:30.480145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:58845)
0812 09:54:30.480450 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:30.480504 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":75,"threads_started":1}
I20260812 09:54:30.675218 30998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:30.674556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:59705)
0812 09:54:30.675037 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:30.675106 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":83,"threads_started":1}
I20260812 09:54:31.305465 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:31.305014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:43601)
0812 09:54:31.305296 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:31.305364 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":82,"threads_started":1}
I20260812 09:54:31.481855 31000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:31.481406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:45115)
0812 09:54:31.481695 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:31.481757 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":77,"threads_started":1}
I20260812 09:54:31.676715 31001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:31.676204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:47093)
0812 09:54:31.676538 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:31.676610 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":80,"threads_started":1}
I20260812 09:54:32.306952 31002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:32.306439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:60389)
0812 09:54:32.306768 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:32.306848 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":84,"threads_started":1}
I20260812 09:54:32.483392 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:32.482783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:39525)
0812 09:54:32.483209 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:32.483281 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":105,"threads_started":1}
I20260812 09:54:32.678175 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:32.677664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:37427)
0812 09:54:32.678011 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:32.678074 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":158,"threads_started":1}
I20260812 09:54:32.709564 31006 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:32.709717 31006 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:32.710310 31006 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
W20260812 09:54:32.711169 30529 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
W20260812 09:54:32.711364 30527 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:32.711476 30527 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef060634fab43899a3e157ef582badf; no voters: 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab
I20260812 09:54:32.711638 31006 raft_consensus.cc:2726] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:54:33.308691 31007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:33.308150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:34823)
0812 09:54:33.308497 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:33.308574 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":90,"threads_started":1}
I20260812 09:54:33.484848 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:33.484340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:44505)
0812 09:54:33.484667 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:33.484739 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":85,"threads_started":1}
I20260812 09:54:33.679661 31009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:33.679180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:33545)
0812 09:54:33.679488 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:33.679556 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":98,"threads_started":1}
I20260812 09:54:34.310426 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:34.309865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:51653)
0812 09:54:34.310247 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:34.310323 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":136,"threads_started":1}
I20260812 09:54:34.486368 31011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:34.485887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:42019)
0812 09:54:34.486195 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:34.486265 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
I20260812 09:54:34.681167 31013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:34.680616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:48085)
0812 09:54:34.680934 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:34.681043 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":97,"threads_started":1}
I20260812 09:54:35.312023 31014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:35.311361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:49143)
0812 09:54:35.311658 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:35.311726 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":80,"threads_started":1}
I20260812 09:54:35.487815 31015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:35.487351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:53357)
0812 09:54:35.487628 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:35.487712 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
I20260812 09:54:35.682668 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:35.682170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:42477)
0812 09:54:35.682489 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:35.682564 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":82,"threads_started":1}
I20260812 09:54:35.818464 31017 raft_consensus.cc:482] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:35.818604 31017 raft_consensus.cc:504] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a097bd0298f4921954b73986165700a" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 36837 } } peers { permanent_uuid: "84cd3c0699c74f73b9f0924c014088ab" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 44871 } } peers { permanent_uuid: "4ef060634fab43899a3e157ef582badf" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 38291 } }
I20260812 09:54:35.819176 31017 leader_election.cc:288] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a097bd0298f4921954b73986165700a (127.11.118.131:36837), 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871)
W20260812 09:54:35.820246 30527 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84cd3c0699c74f73b9f0924c014088ab (127.11.118.130:44871): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
W20260812 09:54:35.820434 30529 leader_election.cc:341] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7a097bd0298f4921954b73986165700a (127.11.118.131:36837): Not found: Tablet not found: 57b6d9b7936f45478fc774c1c2a944f8
I20260812 09:54:35.820544 30529 leader_election.cc:302] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef060634fab43899a3e157ef582badf; no voters: 7a097bd0298f4921954b73986165700a, 84cd3c0699c74f73b9f0924c014088ab
I20260812 09:54:35.820734 31017 raft_consensus.cc:2726] T 57b6d9b7936f45478fc774c1c2a944f8 P 4ef060634fab43899a3e157ef582badf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 09:54:36.313581 31018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:36.313080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:34989)
0812 09:54:36.313395 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:36.313465 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":88,"threads_started":1}
I20260812 09:54:36.489459 31019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:36.489036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:34823)
0812 09:54:36.489296 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:36.489357 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":77,"threads_started":1}
I20260812 09:54:36.684185 31020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:36.683652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:50657)
0812 09:54:36.683988 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:36.684068 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":90,"threads_started":1}
I20260812 09:54:37.315570 31021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:37.314829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:54425)
0812 09:54:37.315378 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:37.315469 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":347,"threads_started":1}
I20260812 09:54:37.491142 31022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:37.490490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:37045)
0812 09:54:37.490881 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:37.491015 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":86,"threads_started":1}
I20260812 09:54:37.685827 31024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:37.685289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:38589)
0812 09:54:37.685642 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:37.685716 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":114,"threads_started":1}
I20260812 09:54:38.316965 31025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:38.316559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.129:34619)
0812 09:54:38.316812 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:38.316869 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":82,"threads_started":1}
I20260812 09:54:38.492583 31026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:38.492111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.130:53333)
0812 09:54:38.492429 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:38.492485 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":88,"threads_started":1}
I20260812 09:54:38.670630 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 30462
I20260812 09:54:38.681602 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 30662
I20260812 09:54:38.687529 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:38.687029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:42505 (local address 127.11.118.131:57651)
0812 09:54:38.687353 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:38.687427 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.190:42505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":92,"threads_started":1}
I20260812 09:54:38.691169 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 30814
2026-08-12T09:54:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60707 ms)
[----------] 30 tests from SecurityITest (262468 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:38 dist-test-slave-2w3w krb5kdc[31030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:38 dist-test-slave-2w3w krb5kdc[31030](info): set up 2 sockets
Aug 12 09:54:38 dist-test-slave-2w3w krb5kdc[31030](info): commencing operation
krb5kdc: starting...
W20260812 09:54:39.848201 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:39 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:54:39.998566 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36143
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:36143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:40.120074 31045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:40.120445 31045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:40.120537 31045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:40.124792 31045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:40.124913 31045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:40.124954 31045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:40.124994 31045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:40.125027 31045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:40.131024 31045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:36143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:40.132325 31045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:40.133498 31045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:54:40.144254 31045 server_base.cc:1034] running on GCE node
W20260812 09:54:40.144196 31052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.144282 31056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.144196 31054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:40.145314 31045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:40.146761 31045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:40.148016 31045 hybrid_clock.cc:648] HybridClock initialized: now 1786528480148001 us; error 74 us; skew 500 ppm
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528480, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:40.151572 31045 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:54:40.152619 31045 webserver.cc:460] Webserver started at http://127.11.118.190:35243/ using document root <none> and password file <none>
I20260812 09:54:40.153246 31045 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:40.153352 31045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:40.153610 31045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:40.155921 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "ee1ac43e375948bb9ce3b8b618815da8"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "38415979f57bcf6dd76e955cfa7be087"
server_key_iv: "fc35ef7295795f478554215b55ab4e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.156553 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "ee1ac43e375948bb9ce3b8b618815da8"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "38415979f57bcf6dd76e955cfa7be087"
server_key_iv: "fc35ef7295795f478554215b55ab4e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.160655 31045 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:40.163305 31063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.164732 31045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:54:40.164906 31045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "ee1ac43e375948bb9ce3b8b618815da8"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "38415979f57bcf6dd76e955cfa7be087"
server_key_iv: "fc35ef7295795f478554215b55ab4e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.165048 31045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:40.188798 31045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:40.192466 31045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:40.192726 31045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:40.200829 31045 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:36143
I20260812 09:54:40.200858 31119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:36143 every 8 connection(s)
I20260812 09:54:40.201925 31045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:40.204998 31120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:40.207486 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31045
I20260812 09:54:40.207662 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:40.208039 11738 external_mini_cluster.cc:1428] Setting key 126b7353df51e547fd44bf76d051caad
I20260812 09:54:40.212136 31120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: Bootstrap starting.
I20260812 09:54:40.214648 31120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:40.215791 31120 log.cc:824] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:40.218001 31120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: No bootstrap required, opened a new log
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:40.223229 31120 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } }
I20260812 09:54:40.223582 31120 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:40.223678 31120 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee1ac43e375948bb9ce3b8b618815da8, State: Initialized, Role: FOLLOWER
I20260812 09:54:40.224212 31120 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } }
I20260812 09:54:40.224385 31120 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:40.224443 31120 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:40.224541 31120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:40.224941 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:40.209761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39930 (local address 127.11.118.190:36143)
0812 09:54:40.210283 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:40.210305 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:40.210356 (+ 51us) server_negotiation.cc:407] Connection header received
0812 09:54:40.211175 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:40.211196 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:40.211577 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:40.211987 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:40.212891 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.213961 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.214934 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.215712 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.215899 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:40.218721 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:40.218728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:40.218747 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:40.218783 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:40.221287 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.221824 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.221831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.221838 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.222000 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.222328 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.222331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.222333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.222945 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:40.223192 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:40.223524 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 09:54:40.223874 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":188,"threads_started":1}
I20260812 09:54:40.225881 31120 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } }
I20260812 09:54:40.226253 31120 leader_election.cc:302] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee1ac43e375948bb9ce3b8b618815da8; no voters:
I20260812 09:54:40.226603 31120 leader_election.cc:288] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:40.226730 31126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:40.227017 31126 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [term 1 LEADER]: Becoming Leader. State: Replica: ee1ac43e375948bb9ce3b8b618815da8, State: Running, Role: LEADER
I20260812 09:54:40.227429 31126 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } }
I20260812 09:54:40.228048 31120 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:40.229562 31129 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee1ac43e375948bb9ce3b8b618815da8. Latest consensus state: current_term: 1 leader_uuid: "ee1ac43e375948bb9ce3b8b618815da8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } } }
I20260812 09:54:40.229558 31127 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee1ac43e375948bb9ce3b8b618815da8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee1ac43e375948bb9ce3b8b618815da8" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 36143 } } }
I20260812 09:54:40.229758 31129 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:40.229779 31127 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:40.230165 31143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:40.235783 31143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:40.248818 31143 catalog_manager.cc:1347] Generated new cluster ID: ccfe5aa0236f412a9571174d00b3c468
I20260812 09:54:40.248925 31143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:40.257835 31143 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:40.258888 31143 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:40.270216 31143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: Generated new TSK 0
I20260812 09:54:40.271311 31143 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:54:40.323971 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:40.470417 31156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:40.470834 31156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:40.470994 31156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:40.478849 31156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:40.478993 31156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:40.479130 31156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:40.488531 31156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:40.490118 31156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:40.491508 31156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:40.504031 31162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.504289 31163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.504304 31165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:40.504470 31156 server_base.cc:1034] running on GCE node
I20260812 09:54:40.505043 31156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:40.505911 31156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:40.507055 31156 hybrid_clock.cc:648] HybridClock initialized: now 1786528480507032 us; error 31 us; skew 500 ppm
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528480, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:40.510890 31156 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:54:40.512023 31156 webserver.cc:460] Webserver started at http://127.11.118.129:38161/ using document root <none> and password file <none>
I20260812 09:54:40.512666 31156 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:40.512738 31156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:40.512988 31156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:40.515328 31156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "1950860e29024dde8a66871b06692747"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "9b1d325db9082da684aa6827a8d932a7"
server_key_iv: "8b0eb20baea54de1d0daaeb6fa2b0717"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.515971 31156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "1950860e29024dde8a66871b06692747"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "9b1d325db9082da684aa6827a8d932a7"
server_key_iv: "8b0eb20baea54de1d0daaeb6fa2b0717"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.520172 31156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:54:40.522933 31172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.524566 31156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:54:40.524736 31156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "1950860e29024dde8a66871b06692747"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "9b1d325db9082da684aa6827a8d932a7"
server_key_iv: "8b0eb20baea54de1d0daaeb6fa2b0717"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.524883 31156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:40.553140 31156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:40.557179 31156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:40.557452 31156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:40.558194 31156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:40.559238 31156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:40.559326 31156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.559408 31156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:40.559455 31156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.570240 31156 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:36455
I20260812 09:54:40.570259 31303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:36455 every 8 connection(s)
I20260812 09:54:40.571337 31156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:40.575353 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31156
I20260812 09:54:40.575510 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:40.575829 11738 external_mini_cluster.cc:1428] Setting key b13718779322078cae80420d82f3188d
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528480, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:54:40.589128 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:40.573321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47155 (local address 127.11.118.190:36143)
0812 09:54:40.573509 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:40.573514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:40.574483 (+ 969us) server_negotiation.cc:407] Connection header received
0812 09:54:40.576256 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:40.576263 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:40.576340 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:40.576448 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:40.578081 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.578642 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.580544 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.580986 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.581129 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:40.584329 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:40.584337 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:40.584342 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:40.584384 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:40.586406 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.587209 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.587213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.587215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.587329 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.587835 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.587842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.587846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.588078 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:40.588164 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:40.588823 (+ 659us) server_negotiation.cc:299] Negotiation successful
0812 09:54:40.588984 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 09:54:40.590169 31306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:40.573789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36143 (local address 127.11.118.129:47155)
0812 09:54:40.574291 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:40.574338 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:40.575972 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:40.576664 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:40.576677 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:40.577163 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:40.577868 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:40.577908 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.578792 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.578799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:40.580373 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:40.580385 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.581196 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.581199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:40.581369 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:40.582102 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:40.582120 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:40.584091 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:40.586579 (+ 2488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:40.586585 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:40.586600 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:40.586929 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:40.587456 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:40.587459 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:40.587460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:40.587694 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:40.588208 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:40.588213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:40.588505 (+ 292us) client_negotiation.cc:769] Sending connection context
0812 09:54:40.588674 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 09:54:40.589136 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":138,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:54:40.591866 31304 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36143
I20260812 09:54:40.592142 31304 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:40.592700 31304 heartbeater.cc:511] Master 127.11.118.190:36143 requested a full tablet report, sending...
I20260812 09:54:40.594342 31080 ts_manager.cc:194] Registered new tserver with Master: 1950860e29024dde8a66871b06692747 (127.11.118.129:36455)
I20260812 09:54:40.596045 31080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:47155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:54:40.611909 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:40.732141 31309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:40.732468 31309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:40.732550 31309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:40.737129 31309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:40.737222 31309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:40.737325 31309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:40.743266 31309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:40.744488 31309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:40.746019 31309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:40.756893 31318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.757006 31321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:40.756907 31315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:40.757124 31309 server_base.cc:1034] running on GCE node
I20260812 09:54:40.757704 31309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:40.758371 31309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:40.759550 31309 hybrid_clock.cc:648] HybridClock initialized: now 1786528480759512 us; error 50 us; skew 500 ppm
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528480, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:40.762663 31309 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:54:40.763827 31309 webserver.cc:460] Webserver started at http://127.11.118.130:40065/ using document root <none> and password file <none>
I20260812 09:54:40.764449 31309 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:40.764555 31309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:40.764858 31309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:40.767127 31309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "a0684898264144bc903bdd1a576392e0"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "082ed74e16f61453b45e55c18b95bd0d"
server_key_iv: "70a66942cd67da0075c4acd86aec1cf4"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.767763 31309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "a0684898264144bc903bdd1a576392e0"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "082ed74e16f61453b45e55c18b95bd0d"
server_key_iv: "70a66942cd67da0075c4acd86aec1cf4"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.772246 31309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:54:40.774938 31328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.776468 31309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:40.776618 31309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "a0684898264144bc903bdd1a576392e0"
format_stamp: "Formatted at 2026-08-12 09:54:40 on dist-test-slave-2w3w"
server_key: "082ed74e16f61453b45e55c18b95bd0d"
server_key_iv: "70a66942cd67da0075c4acd86aec1cf4"
server_key_version: "encryptionkey@0"
I20260812 09:54:40.776746 31309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:40.814862 31309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:40.818611 31309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:40.818887 31309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:40.819612 31309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:40.820544 31309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:40.820595 31309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.820638 31309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:40.820695 31309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:40.831022 31309 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39433
I20260812 09:54:40.831043 31453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39433 every 8 connection(s)
I20260812 09:54:40.832010 31309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:40.841652 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31309
I20260812 09:54:40.841809 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:40.842133 11738 external_mini_cluster.cc:1428] Setting key 2204fd643cdc3e799e747feba1bf9727
Aug 12 09:54:40 dist-test-slave-2w3w krb5kdc[31030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528480, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:40.847766 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:40.833979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:52231 (local address 127.11.118.190:36143)
0812 09:54:40.834160 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:40.834166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:40.835171 (+ 1005us) server_negotiation.cc:407] Connection header received
0812 09:54:40.836465 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:40.836468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:40.836518 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:40.836602 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:40.837837 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.838398 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.839633 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.839913 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.840007 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:40.843458 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:40.843462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:40.843464 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:40.843517 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:40.845256 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.845897 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.845906 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.845908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.845994 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:40.846416 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:40.846419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:40.846421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:40.846627 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:40.846744 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:40.847438 (+ 694us) server_negotiation.cc:299] Negotiation successful
0812 09:54:40.847591 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 09:54:40.848913 31456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:40.834458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36143 (local address 127.11.118.130:52231)
0812 09:54:40.834946 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:40.835057 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:40.836244 (+ 1187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:40.836776 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:40.836783 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:40.837154 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:40.837658 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:40.837672 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.838533 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.838536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:40.839499 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:40.839510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:40.840065 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:40.840068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:40.840220 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:40.840938 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:40.840956 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:40.843255 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:40.845424 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:40.845431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:40.845449 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:40.845755 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:40.846098 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:40.846102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:40.846104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:40.846282 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:40.846745 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:40.846753 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:40.847152 (+ 399us) client_negotiation.cc:769] Sending connection context
0812 09:54:40.847375 (+ 223us) client_negotiation.cc:240] Negotiation successful
0812 09:54:40.847763 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":117,"threads_started":1}
I20260812 09:54:40.850559 31454 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36143
I20260812 09:54:40.850863 31454 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:40.851493 31454 heartbeater.cc:511] Master 127.11.118.190:36143 requested a full tablet report, sending...
I20260812 09:54:40.852988 31080 ts_manager.cc:194] Registered new tserver with Master: a0684898264144bc903bdd1a576392e0 (127.11.118.130:39433)
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:54:40.853920 31080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:52231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:54:40.879272 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:41.005333 31459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:41.005729 31459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:41.005817 31459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:41.010243 31459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:41.010346 31459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:41.010411 31459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:41.016392 31459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:41.017611 31459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:41.018731 31459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:41.029611 31464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:41.029698 31468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:41.029882 31465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:41.030011 31459 server_base.cc:1034] running on GCE node
I20260812 09:54:41.030689 31459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:41.031769 31459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:41.032999 31459 hybrid_clock.cc:648] HybridClock initialized: now 1786528481032960 us; error 52 us; skew 500 ppm
Aug 12 09:54:41 dist-test-slave-2w3w krb5kdc[31030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528481, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:41.037487 31459 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:54:41.038522 31459 webserver.cc:460] Webserver started at http://127.11.118.131:34453/ using document root <none> and password file <none>
I20260812 09:54:41.039223 31459 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:41.039299 31459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:41.039539 31459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:41.041819 31459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "d9a066d2a81949acb622aa9edc57268c"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "766c622f359aa4817ff2ac9861100109"
server_key_iv: "c521963eedacc3bc2181d37e48484ac2"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.042491 31459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "d9a066d2a81949acb622aa9edc57268c"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "766c622f359aa4817ff2ac9861100109"
server_key_iv: "c521963eedacc3bc2181d37e48484ac2"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.047292 31459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260812 09:54:41.050908 31478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:41.053368 31459 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:54:41.053646 31459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "d9a066d2a81949acb622aa9edc57268c"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "766c622f359aa4817ff2ac9861100109"
server_key_iv: "c521963eedacc3bc2181d37e48484ac2"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.053824 31459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:41.076583 31459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:41.080287 31459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:41.080587 31459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:41.081246 31459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:41.082247 31459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:41.082319 31459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:41.082417 31459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:41.082458 31459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:41.093530 31459 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:40339
I20260812 09:54:41.093560 31609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:40339 every 8 connection(s)
I20260812 09:54:41.094547 31459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:41.098152 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31459
I20260812 09:54:41.098310 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:41.098588 11738 external_mini_cluster.cc:1428] Setting key 5c4648051fb08eab55d886b24b3a2b23
Aug 12 09:54:41 dist-test-slave-2w3w krb5kdc[31030](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528481, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:41.110152 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.096637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:48913 (local address 127.11.118.190:36143)
0812 09:54:41.096790 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.096793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.097669 (+ 876us) server_negotiation.cc:407] Connection header received
0812 09:54:41.099526 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.099531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.099599 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.099686 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:41.101196 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.101741 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.103215 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.103451 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.103548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.106387 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:41.106391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:41.106394 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:41.106424 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:41.108079 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:41.108663 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:41.108666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:41.108667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:41.108751 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:41.109144 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:41.109147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:41.109148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:41.109339 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:41.109422 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.109904 (+ 482us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.110019 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:54:41.111382 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.097017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:36143 (local address 127.11.118.131:48913)
0812 09:54:41.097510 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.097554 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.099130 (+ 1576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.100026 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.100036 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.100451 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:41.101055 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.101071 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.101898 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.101901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.103074 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.103097 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.103636 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.103639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.103810 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.104401 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:41.104419 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:41.106195 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:41.108212 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:41.108218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:41.108231 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:41.108539 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:41.108886 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:41.108888 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:41.108890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:41.109053 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:41.109434 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:41.109439 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:41.109690 (+ 251us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.109852 (+ 162us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.110188 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":129,"threads_started":1}
I20260812 09:54:41.112622 31610 heartbeater.cc:347] Connected to a master server at 127.11.118.190:36143
I20260812 09:54:41.112933 31610 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:41.113490 31610 heartbeater.cc:511] Master 127.11.118.190:36143 requested a full tablet report, sending...
I20260812 09:54:41.114555 31080 ts_manager.cc:194] Registered new tserver with Master: d9a066d2a81949acb622aa9edc57268c (127.11.118.131:40339)
I20260812 09:54:41.115250 31080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:48913
I20260812 09:54:41.125378 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:41.136802 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.127739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39938 (local address 127.11.118.190:36143)
0812 09:54:41.127915 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.127920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.128172 (+ 252us) server_negotiation.cc:407] Connection header received
0812 09:54:41.128334 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.128337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.128465 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.128556 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:41.129474 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.130027 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.131101 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.131319 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.131423 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.132977 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:41.132980 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:41.132982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:41.133007 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:41.134584 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:41.135213 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:41.135216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:41.135217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:41.135315 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:41.135780 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:41.135784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:41.135786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:41.136116 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:41.136247 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.136553 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.136671 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:54:41.140537 31080 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:41.143750 31080 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:41.161026 31626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.153082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40339 (local address 127.0.0.1:43852)
0812 09:54:41.154571 (+ 1489us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.154584 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.154684 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.155594 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.155599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.155618 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.155726 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.155988 (+ 262us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.157512 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.157516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.158997 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.159009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.160320 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.160323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.160456 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.160558 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.160683 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.160839 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1433,"mutex_wait_us":1004,"thread_start_us":108,"threads_started":1}
I20260812 09:54:41.161026 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.153082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39433 (local address 127.0.0.1:45360)
0812 09:54:41.153498 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.153562 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.153697 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.155444 (+ 1747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.155447 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.155464 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.155576 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.155583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.157189 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.157193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.158755 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.158773 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.160292 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.160296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.160471 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.160557 (+ 86us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.160683 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.160870 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":127,"thread_start_us":141,"threads_started":1}
I20260812 09:54:41.161767 31627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.154038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.11.118.130:39433)
0812 09:54:41.154926 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.154935 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.154953 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:54:41.155076 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.155080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.155259 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.155454 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.155708 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.157009 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.158915 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.159997 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.160170 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.160325 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.161502 (+ 1177us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.161605 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":108,"threads_started":1}
I20260812 09:54:41.161756 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.153661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.11.118.131:40339)
0812 09:54:41.154168 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.154181 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.154687 (+ 506us) server_negotiation.cc:407] Connection header received
0812 09:54:41.154868 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.154872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.155083 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.155243 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.156254 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.157352 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.159121 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.160064 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.160183 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.160325 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.161476 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.161605 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":122,"threads_started":1}
I20260812 09:54:41.162174 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.154007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.11.118.129:36455)
0812 09:54:41.154443 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.154449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.154536 (+ 87us) server_negotiation.cc:407] Connection header received
0812 09:54:41.154818 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.154825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.155083 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.155243 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.155593 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.156943 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.160415 (+ 3472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.161327 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.161459 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.161604 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.161913 (+ 309us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.162020 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":143,"threads_started":1}
I20260812 09:54:41.162930 31623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.153627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:36455 (local address 127.0.0.1:46168)
0812 09:54:41.154393 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.154406 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.154536 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.155249 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.155256 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.155280 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.155458 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.155467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.157098 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.157102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.158997 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.159009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.161674 (+ 2665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.161677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.161758 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.161776 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.161876 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.162781 (+ 905us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":133,"thread_start_us":127,"threads_started":1}
I20260812 09:54:41.165035 31537 tablet_service.cc:1467] Processing CreateTablet for tablet 82ba7b363cd74d3898740134312b0806 (DEFAULT_TABLE table=test-table [id=c20455eff5bc4f3fa8090144ff11fcc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:41.164997 31379 tablet_service.cc:1467] Processing CreateTablet for tablet 82ba7b363cd74d3898740134312b0806 (DEFAULT_TABLE table=test-table [id=c20455eff5bc4f3fa8090144ff11fcc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:41.166126 31379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ba7b363cd74d3898740134312b0806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:41.166169 31537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ba7b363cd74d3898740134312b0806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:41.165813 31229 tablet_service.cc:1467] Processing CreateTablet for tablet 82ba7b363cd74d3898740134312b0806 (DEFAULT_TABLE table=test-table [id=c20455eff5bc4f3fa8090144ff11fcc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:41.166841 31229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82ba7b363cd74d3898740134312b0806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:41.173339 31630 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Bootstrap starting.
I20260812 09:54:41.174865 31631 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Bootstrap starting.
I20260812 09:54:41.175206 31632 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Bootstrap starting.
I20260812 09:54:41.176406 31630 tablet_bootstrap.cc:654] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:41.177902 31630 log.cc:824] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:41.178246 31632 tablet_bootstrap.cc:654] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:41.178428 31631 tablet_bootstrap.cc:654] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:41.179283 31632 log.cc:824] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:41.179721 31631 log.cc:824] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:41.180395 31630 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: No bootstrap required, opened a new log
I20260812 09:54:41.180613 31630 ts_tablet_manager.cc:1397] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260812 09:54:41.181493 31632 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: No bootstrap required, opened a new log
I20260812 09:54:41.181643 31631 tablet_bootstrap.cc:492] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: No bootstrap required, opened a new log
I20260812 09:54:41.181699 31632 ts_tablet_manager.cc:1397] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:54:41.181841 31631 ts_tablet_manager.cc:1397] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 09:54:41.184891 31631 raft_consensus.cc:348] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.185195 31631 raft_consensus.cc:374] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:41.185256 31631 raft_consensus.cc:729] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a066d2a81949acb622aa9edc57268c, State: Initialized, Role: FOLLOWER
I20260812 09:54:41.185767 31631 consensus_queue.cc:260] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.186549 31610 heartbeater.cc:503] Master 127.11.118.190:36143 was elected leader, sending a full tablet report...
I20260812 09:54:41.186352 31632 raft_consensus.cc:348] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.186352 31630 raft_consensus.cc:348] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.186642 31632 raft_consensus.cc:374] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:41.186642 31630 raft_consensus.cc:374] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:41.186697 31630 raft_consensus.cc:729] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0684898264144bc903bdd1a576392e0, State: Initialized, Role: FOLLOWER
I20260812 09:54:41.186697 31632 raft_consensus.cc:729] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1950860e29024dde8a66871b06692747, State: Initialized, Role: FOLLOWER
I20260812 09:54:41.186949 31631 ts_tablet_manager.cc:1428] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260812 09:54:41.187207 31632 consensus_queue.cc:260] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.187245 31630 consensus_queue.cc:260] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.188194 31454 heartbeater.cc:503] Master 127.11.118.190:36143 was elected leader, sending a full tablet report...
I20260812 09:54:41.188261 31630 ts_tablet_manager.cc:1428] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260812 09:54:41.188261 31632 ts_tablet_manager.cc:1428] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 09:54:41.189306 31304 heartbeater.cc:503] Master 127.11.118.190:36143 was elected leader, sending a full tablet report...
W20260812 09:54:41.322993 31305 tablet.cc:2369] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:54:41.333351 31455 tablet.cc:2369] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:54:41.345714 31611 tablet.cc:2369] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:54:41.424623 31637 raft_consensus.cc:482] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:41.425058 31637 raft_consensus.cc:504] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.426473 31637 leader_election.cc:288] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0684898264144bc903bdd1a576392e0 (127.11.118.130:39433), 1950860e29024dde8a66871b06692747 (127.11.118.129:36455)
I20260812 09:54:41.430558 31639 raft_consensus.cc:482] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:41.430766 31639 raft_consensus.cc:504] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.431371 31640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.426801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39433 (local address 127.11.118.131:53553)
0812 09:54:41.427323 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.427338 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.427445 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.427674 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.427676 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.427692 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.427799 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.427803 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.428723 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.428730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.429871 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.429888 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.430906 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.430911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.431029 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.431054 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.431134 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.431207 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":139,"thread_start_us":158,"threads_started":1}
I20260812 09:54:41.431386 31627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.426925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:53553 (local address 127.11.118.130:39433)
0812 09:54:41.427051 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.427057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.427462 (+ 405us) server_negotiation.cc:407] Connection header received
0812 09:54:41.427519 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.427522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.427576 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.427650 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.428004 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.428612 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.430016 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.430661 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.430787 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.430838 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.431166 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.431266 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:54:41.431416 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.426803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:36455 (local address 127.11.118.131:47881)
0812 09:54:41.426984 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.427001 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.427111 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.427758 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.427760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.427776 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.427871 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.427875 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.428723 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.428728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.429918 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.429928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.431002 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.431005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.431134 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.431161 (+ 27us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.431233 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.431302 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":111}
I20260812 09:54:41.431788 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.426891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:47881 (local address 127.11.118.129:36455)
0812 09:54:41.427045 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.427050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.427070 (+ 20us) server_negotiation.cc:407] Connection header received
0812 09:54:41.427255 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.427259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.427325 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.427445 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.428004 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.428615 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.430102 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.430710 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.430847 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.430901 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.431537 (+ 636us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.431640 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 09:54:41.432291 31402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "d9a066d2a81949acb622aa9edc57268c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0684898264144bc903bdd1a576392e0" is_pre_election: true
I20260812 09:54:41.432503 31248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "d9a066d2a81949acb622aa9edc57268c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1950860e29024dde8a66871b06692747" is_pre_election: true
I20260812 09:54:41.432547 31402 raft_consensus.cc:2454] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a066d2a81949acb622aa9edc57268c in term 0.
I20260812 09:54:41.432801 31248 raft_consensus.cc:2454] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a066d2a81949acb622aa9edc57268c in term 0.
I20260812 09:54:41.432863 31639 leader_election.cc:288] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a066d2a81949acb622aa9edc57268c (127.11.118.131:40339), 1950860e29024dde8a66871b06692747 (127.11.118.129:36455)
I20260812 09:54:41.433202 31479 leader_election.cc:302] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0684898264144bc903bdd1a576392e0, d9a066d2a81949acb622aa9edc57268c; no voters:
I20260812 09:54:41.433527 31637 raft_consensus.cc:2781] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:41.433629 31637 raft_consensus.cc:482] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:41.433679 31637 raft_consensus.cc:3037] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:41.435009 31637 raft_consensus.cc:504] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.435775 31402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "d9a066d2a81949acb622aa9edc57268c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0684898264144bc903bdd1a576392e0"
I20260812 09:54:41.435804 31248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "d9a066d2a81949acb622aa9edc57268c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1950860e29024dde8a66871b06692747"
I20260812 09:54:41.435913 31402 raft_consensus.cc:3037] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:41.435940 31248 raft_consensus.cc:3037] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:41.437340 31248 raft_consensus.cc:2454] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a066d2a81949acb622aa9edc57268c in term 1.
I20260812 09:54:41.437337 31402 raft_consensus.cc:2454] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a066d2a81949acb622aa9edc57268c in term 1.
I20260812 09:54:41.437711 31481 leader_election.cc:302] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1950860e29024dde8a66871b06692747, d9a066d2a81949acb622aa9edc57268c; no voters:
I20260812 09:54:41.437819 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.432808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:38181 (local address 127.11.118.129:36455)
0812 09:54:41.433134 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.433140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.433379 (+ 239us) server_negotiation.cc:407] Connection header received
0812 09:54:41.433520 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.433524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.433571 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.433622 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.434048 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.434761 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.436411 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.437000 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.437093 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.437159 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.437613 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.437701 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248}
I20260812 09:54:41.438010 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.432448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:40339 (local address 127.11.118.130:37117)
0812 09:54:41.433090 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.433105 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.433253 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.433602 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.433605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.433621 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.433763 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.433772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.434791 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.434797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.436265 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.436280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.437281 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.437286 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.437462 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.437487 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.437743 (+ 256us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.437827 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":138,"thread_start_us":113,"threads_started":1}
I20260812 09:54:41.438103 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.432812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:37117 (local address 127.11.118.131:40339)
0812 09:54:41.432926 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.432930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.433179 (+ 249us) server_negotiation.cc:407] Connection header received
0812 09:54:41.433369 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.433372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.433420 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.433469 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:41.433870 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.434642 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.436419 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.437011 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.437103 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.437159 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.437619 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.437705 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 09:54:41.438215 31637 leader_election.cc:288] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [CANDIDATE]: Term 1 election: Requested vote from peers a0684898264144bc903bdd1a576392e0 (127.11.118.130:39433), 1950860e29024dde8a66871b06692747 (127.11.118.129:36455)
I20260812 09:54:41.438222 31641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.432472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:36455 (local address 127.11.118.130:38181)
0812 09:54:41.433288 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.433302 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:41.433397 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:41.433764 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:41.433768 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:41.433787 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:41.433918 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.433928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.434853 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.434857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.436247 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:41.436262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.437268 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.437274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:41.437458 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.437482 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:54:41.437975 (+ 493us) client_negotiation.cc:240] Negotiation successful
0812 09:54:41.438057 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":142,"thread_start_us":92,"threads_started":1}
I20260812 09:54:41.438354 31637 raft_consensus.cc:2781] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:41.438452 31637 raft_consensus.cc:686] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 1 LEADER]: Becoming Leader. State: Replica: d9a066d2a81949acb622aa9edc57268c, State: Running, Role: LEADER
I20260812 09:54:41.438625 31557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "a0684898264144bc903bdd1a576392e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a066d2a81949acb622aa9edc57268c" is_pre_election: true
I20260812 09:54:41.438808 31637 consensus_queue.cc:237] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } }
I20260812 09:54:41.438834 31248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82ba7b363cd74d3898740134312b0806" candidate_uuid: "a0684898264144bc903bdd1a576392e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1950860e29024dde8a66871b06692747" is_pre_election: true
I20260812 09:54:41.439044 31248 raft_consensus.cc:2379] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0684898264144bc903bdd1a576392e0 in current term 1: Already voted for candidate d9a066d2a81949acb622aa9edc57268c in this term.
I20260812 09:54:41.439466 31330 leader_election.cc:302] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0684898264144bc903bdd1a576392e0; no voters: 1950860e29024dde8a66871b06692747, d9a066d2a81949acb622aa9edc57268c
I20260812 09:54:41.439754 31639 raft_consensus.cc:2726] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 09:54:41.442222 31079 catalog_manager.cc:5495] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a066d2a81949acb622aa9edc57268c (127.11.118.131). New cstate: current_term: 1 leader_uuid: "d9a066d2a81949acb622aa9edc57268c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a066d2a81949acb622aa9edc57268c" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 } health_report { overall_health: UNKNOWN } } }
I20260812 09:54:41.457350 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.453238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43858 (local address 127.11.118.131:40339)
0812 09:54:41.453413 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.453417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.453433 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:54:41.453608 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.453610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.453666 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.453784 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:41.454076 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.454589 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.455726 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.455966 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.456087 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.456430 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:41.456906 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:41.457049 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.457114 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.457176 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:54:41.463688 31248 raft_consensus.cc:1261] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 1 FOLLOWER]: Refusing update from remote peer d9a066d2a81949acb622aa9edc57268c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:41.463735 31402 raft_consensus.cc:1261] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 1 FOLLOWER]: Refusing update from remote peer d9a066d2a81949acb622aa9edc57268c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:41.464679 31643 consensus_queue.cc:1035] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1950860e29024dde8a66871b06692747" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 36455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:41.464884 31637 consensus_queue.cc:1035] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0684898264144bc903bdd1a576392e0" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:41.472718 31646 mvcc.cc:205] Tried to move back new op lower bound from 7317620660067835904 to 7317620659976830976. Current Snapshot: MvccSnapshot[applied={T|T < 7317620660067835904}]
I20260812 09:54:41.475317 31648 mvcc.cc:205] Tried to move back new op lower bound from 7317620660067835904 to 7317620659976830976. Current Snapshot: MvccSnapshot[applied={T|T < 7317620660067835904}]
I20260812 09:54:41.483867 31080 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:41.484113 31080 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:41.486981 31080 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ee1ac43e375948bb9ce3b8b618815da8: Sending DeleteTablet for 3 replicas of tablet 82ba7b363cd74d3898740134312b0806
I20260812 09:54:41.488034 31537 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ba7b363cd74d3898740134312b0806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:41 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:43852
I20260812 09:54:41.488065 31379 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ba7b363cd74d3898740134312b0806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:41 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:45360
I20260812 09:54:41.488065 31229 tablet_service.cc:1514] Processing DeleteTablet for tablet 82ba7b363cd74d3898740134312b0806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:41 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:46168
I20260812 09:54:41.488691 31657 tablet_replica.cc:330] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: stopping tablet replica
I20260812 09:54:41.489108 31657 raft_consensus.cc:2229] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:41.489353 31659 tablet_replica.cc:330] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747: stopping tablet replica
I20260812 09:54:41.489478 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31156
I20260812 09:54:41.489753 31659 raft_consensus.cc:2229] T 82ba7b363cd74d3898740134312b0806 P 1950860e29024dde8a66871b06692747 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:41.490168 31657 raft_consensus.cc:2258] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:41.493571 31657 ts_tablet_manager.cc:1905] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:41.496364 31658 tablet_replica.cc:330] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: stopping tablet replica
I20260812 09:54:41.496747 31658 raft_consensus.cc:2229] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:54:41.497174 31657 ts_tablet_manager.cc:1918] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:41.497236 31658 raft_consensus.cc:2258] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:41.497301 31657 log.cc:1196] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/82ba7b363cd74d3898740134312b0806
I20260812 09:54:41.497648 31657 ts_tablet_manager.cc:1939] T 82ba7b363cd74d3898740134312b0806 P a0684898264144bc903bdd1a576392e0: Deleting consensus metadata
I20260812 09:54:41.499029 31658 ts_tablet_manager.cc:1905] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:41.499171 31064 catalog_manager.cc:4841] TS a0684898264144bc903bdd1a576392e0 (127.11.118.130:39433): tablet 82ba7b363cd74d3898740134312b0806 (table test-table [id=c20455eff5bc4f3fa8090144ff11fcc6]) successfully deleted
I20260812 09:54:41.501963 31658 ts_tablet_manager.cc:1918] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:41.502079 31658 log.cc:1196] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/82ba7b363cd74d3898740134312b0806
I20260812 09:54:41.502425 31658 ts_tablet_manager.cc:1939] T 82ba7b363cd74d3898740134312b0806 P d9a066d2a81949acb622aa9edc57268c: Deleting consensus metadata
W20260812 09:54:41.502708 31065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:36455 (error 108)
I20260812 09:54:41.502907 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31309
I20260812 09:54:41.506953 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.506223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:36455 (local address 127.0.0.1:46176)
0812 09:54:41.506738 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:41.506833 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:36455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411}
W20260812 09:54:41.511148 31065 catalog_manager.cc:4584] TS 1950860e29024dde8a66871b06692747 (127.11.118.129:36455): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82ba7b363cd74d3898740134312b0806: Network error: Client connection negotiation failed: client connection to 127.11.118.129:36455: connect: Connection refused (error 111)
I20260812 09:54:41.513130 31067 catalog_manager.cc:4841] TS d9a066d2a81949acb622aa9edc57268c (127.11.118.131:40339): tablet 82ba7b363cd74d3898740134312b0806 (table test-table [id=c20455eff5bc4f3fa8090144ff11fcc6]) successfully deleted
I20260812 09:54:41.519605 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31459
I20260812 09:54:41.529450 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31045
2026-08-12T09:54:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2838 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T09:54:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:41Z Disabled control of system clock
I20260812 09:54:41.567881 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40521
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:41.688259 31665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:41.688594 31665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:41.688633 31665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:41.692926 31665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:41.693018 31665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:41.693034 31665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:41.693053 31665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:41.693069 31665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:41.698217 31665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:41.699416 31665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:41.700845 31665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:41.709988 31671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:41.709988 31675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:41.709906 31670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:41.710165 31665 server_base.cc:1034] running on GCE node
I20260812 09:54:41.711030 31665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:41.712215 31665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:41.713438 31665 hybrid_clock.cc:648] HybridClock initialized: now 1786528481713407 us; error 46 us; skew 500 ppm
I20260812 09:54:41.716398 31665 webserver.cc:460] Webserver started at http://127.11.118.190:35643/ using document root <none> and password file <none>
I20260812 09:54:41.717088 31665 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:41.717200 31665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:41.717471 31665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:41.720227 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "61b801fe020646e09521a32b972e058e"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "ced81aec4138ba0b3557eff3cc622b01"
server_key_iv: "8add9998dfcbf823d443c3ed71db1f6e"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.720871 31665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "61b801fe020646e09521a32b972e058e"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "ced81aec4138ba0b3557eff3cc622b01"
server_key_iv: "8add9998dfcbf823d443c3ed71db1f6e"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.725049 31665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:41.728027 31681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:41.729507 31665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:41.729686 31665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "61b801fe020646e09521a32b972e058e"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "ced81aec4138ba0b3557eff3cc622b01"
server_key_iv: "8add9998dfcbf823d443c3ed71db1f6e"
server_key_version: "encryptionkey@0"
I20260812 09:54:41.729835 31665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:41.747368 31665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:41.748171 31665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:41.748395 31665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:41.756501 31665 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:40521
I20260812 09:54:41.756515 31743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:40521 every 8 connection(s)
I20260812 09:54:41.757584 31665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:41.760829 31745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:41.766472 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31665
I20260812 09:54:41.766592 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:41.766952 11738 external_mini_cluster.cc:1428] Setting key e4f230c66b1290211f7dc5d9e648012b
I20260812 09:54:41.767134 31745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: Bootstrap starting.
I20260812 09:54:41.769948 31745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:41.770833 31745 log.cc:824] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:41.772926 31745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: No bootstrap required, opened a new log
I20260812 09:54:41.777015 31745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } }
I20260812 09:54:41.777319 31745 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:41.777410 31745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b801fe020646e09521a32b972e058e, State: Initialized, Role: FOLLOWER
I20260812 09:54:41.777683 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:41.768740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.11.118.190:40521)
0812 09:54:41.769478 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:41.769494 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:41.769533 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:54:41.770449 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:41.770471 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:41.771054 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:41.771436 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:41.771891 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.772890 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.773837 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:41.774359 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:41.774559 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:41.775586 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:41.775592 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:41.775606 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:41.776086 (+ 480us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:41.776153 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:41.776175 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:41.776295 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:41.776460 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 09:54:41.776741 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":176,"threads_started":1}
I20260812 09:54:41.778122 31745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } }
I20260812 09:54:41.778308 31745 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:41.778378 31745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:41.778473 31745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:41.779636 31745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } }
I20260812 09:54:41.780094 31745 leader_election.cc:302] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61b801fe020646e09521a32b972e058e; no voters:
I20260812 09:54:41.780457 31745 leader_election.cc:288] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:41.780602 31750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:41.780882 31750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [term 1 LEADER]: Becoming Leader. State: Replica: 61b801fe020646e09521a32b972e058e, State: Running, Role: LEADER
I20260812 09:54:41.781242 31750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } }
I20260812 09:54:41.781756 31745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:41.782414 31750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61b801fe020646e09521a32b972e058e. Latest consensus state: current_term: 1 leader_uuid: "61b801fe020646e09521a32b972e058e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } } }
I20260812 09:54:41.782546 31750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:41.783396 31757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:41.785010 31752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61b801fe020646e09521a32b972e058e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61b801fe020646e09521a32b972e058e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40521 } } }
I20260812 09:54:41.785123 31752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:41.786640 31757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:41.793588 31757 catalog_manager.cc:1347] Generated new cluster ID: a7a402a5376545018d464076e8e59331
I20260812 09:54:41.793774 31757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:41.809401 31757 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:41.810529 31757 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:41.819284 31757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: Generated new TSK 0
I20260812 09:54:41.820123 31757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:41.831092 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--builtin_ntp_servers=127.11.118.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:41.971603 31770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:41.971941 31770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:41.971985 31770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:41.976336 31770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:41.976424 31770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:41.976483 31770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:41.981856 31770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:41.983407 31770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:41.984885 31770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:41.995960 31779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:41.996026 31782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:41.995961 31770 server_base.cc:1034] running on GCE node
W20260812 09:54:41.995995 31778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:41.996590 31770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:41.997387 31770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:41.998586 31770 hybrid_clock.cc:648] HybridClock initialized: now 1786528481998567 us; error 32 us; skew 500 ppm
I20260812 09:54:42.001225 31770 webserver.cc:460] Webserver started at http://127.11.118.129:45479/ using document root <none> and password file <none>
I20260812 09:54:42.001861 31770 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:42.001936 31770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:42.002303 31770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:42.004971 31770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "9430be0dd962462f988a1f22003046fa"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "f68abe879cae29b54bf184b72ca4e05a"
server_key_iv: "876ae2db439ae3aa38077313361a6dda"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.005636 31770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "9430be0dd962462f988a1f22003046fa"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "f68abe879cae29b54bf184b72ca4e05a"
server_key_iv: "876ae2db439ae3aa38077313361a6dda"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.010358 31770 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260812 09:54:42.013598 31788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.015102 31770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:42.015272 31770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "9430be0dd962462f988a1f22003046fa"
format_stamp: "Formatted at 2026-08-12 09:54:41 on dist-test-slave-2w3w"
server_key: "f68abe879cae29b54bf184b72ca4e05a"
server_key_iv: "876ae2db439ae3aa38077313361a6dda"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.015420 31770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:42.028430 31770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:42.029215 31770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:42.029440 31770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:42.030093 31770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:42.031186 31770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:42.031275 31770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.031351 31770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:42.031405 31770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.041759 31770 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:37197
I20260812 09:54:42.041774 31917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:37197 every 8 connection(s)
I20260812 09:54:42.042757 31770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:42.051316 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31770
I20260812 09:54:42.051465 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:42.051785 11738 external_mini_cluster.cc:1428] Setting key dca094adb684039f61dbae9d068eca70
I20260812 09:54:42.053768 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.044854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:34821 (local address 127.11.118.190:40521)
0812 09:54:42.045017 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.045021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.046160 (+ 1139us) server_negotiation.cc:407] Connection header received
0812 09:54:42.047824 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.047827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.047897 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.048009 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:42.049041 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.049613 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.051018 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.051493 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.051660 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.053042 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:42.053045 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:42.053048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:42.053064 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:42.053229 (+ 165us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:42.053245 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:42.053367 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.053551 (+ 184us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.053621 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:54:42.054183 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--builtin_ntp_servers=127.11.118.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:42.054872 31920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.045146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40521 (local address 127.11.118.129:34821)
0812 09:54:42.045985 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.046032 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.047550 (+ 1518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.048226 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.048234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.048329 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:42.048870 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.048885 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.049779 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.049782 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.050816 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.050833 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.051718 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.051723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.051967 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.052709 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:42.052711 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:42.052768 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:42.052850 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:42.053371 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:42.053392 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:42.053401 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.053551 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.053906 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":176,"threads_started":1}
I20260812 09:54:42.056267 31918 heartbeater.cc:347] Connected to a master server at 127.11.118.190:40521
I20260812 09:54:42.056550 31918 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:42.057138 31918 heartbeater.cc:511] Master 127.11.118.190:40521 requested a full tablet report, sending...
I20260812 09:54:42.058914 31702 ts_manager.cc:194] Registered new tserver with Master: 9430be0dd962462f988a1f22003046fa (127.11.118.129:37197)
I20260812 09:54:42.061133 31702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.129:34821
W20260812 09:54:42.178014 31921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:42.178325 31921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:42.178367 31921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:42.182677 31921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:42.182749 31921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:42.182904 31921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:42.188086 31921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:42.189244 31921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:42.190657 31921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:42.201280 31932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:42.201280 31928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:42.201288 31929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:42.201757 31921 server_base.cc:1034] running on GCE node
I20260812 09:54:42.202318 31921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:42.203421 31921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:42.204643 31921 hybrid_clock.cc:648] HybridClock initialized: now 1786528482204610 us; error 46 us; skew 500 ppm
I20260812 09:54:42.206573 31921 webserver.cc:460] Webserver started at http://127.11.118.130:34239/ using document root <none> and password file <none>
I20260812 09:54:42.207239 31921 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:42.207314 31921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:42.207491 31921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:42.210026 31921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "571dcd43cea54c45a7582d5f2ee378a9"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "1c142355cf3187a1a887408b6081f85a"
server_key_iv: "80f532ca90b26a072b088b5735325a52"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.210706 31921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "571dcd43cea54c45a7582d5f2ee378a9"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "1c142355cf3187a1a887408b6081f85a"
server_key_iv: "80f532ca90b26a072b088b5735325a52"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.214941 31921 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 09:54:42.217687 31938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.219235 31921 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 09:54:42.219398 31921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "571dcd43cea54c45a7582d5f2ee378a9"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "1c142355cf3187a1a887408b6081f85a"
server_key_iv: "80f532ca90b26a072b088b5735325a52"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.219538 31921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:42.239159 31921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:42.239957 31921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:42.240185 31921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:42.240861 31921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:42.241888 31921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:42.241963 31921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.242038 31921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:42.242090 31921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.251756 31921 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:32893
I20260812 09:54:42.251883 32068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:32893 every 8 connection(s)
I20260812 09:54:42.252837 31921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:42.253724 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 31921
I20260812 09:54:42.253878 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:42.254221 11738 external_mini_cluster.cc:1428] Setting key 363e097fe51bad8b82ad6aa14aabd270
I20260812 09:54:42.256971 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--builtin_ntp_servers=127.11.118.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:42.266115 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.255281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:34851 (local address 127.11.118.190:40521)
0812 09:54:42.255439 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.255443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.256967 (+ 1524us) server_negotiation.cc:407] Connection header received
0812 09:54:42.259454 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.259459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.259534 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.259650 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:42.260697 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.261289 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.263442 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.263690 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.263784 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.265450 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:42.265453 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:42.265456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:42.265472 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:42.265495 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:42.265513 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:42.265587 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.265887 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.265958 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:54:42.267530 32072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.255736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40521 (local address 127.11.118.130:34851)
0812 09:54:42.256743 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.256814 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.259136 (+ 2322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.259865 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.259874 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.259971 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:42.260538 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.260552 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.261458 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.261465 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.263218 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.263237 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.263887 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.263893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.264169 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.264998 (+ 829us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:42.265002 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:42.265076 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:42.265191 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:42.265620 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:42.265634 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:42.265644 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.265810 (+ 166us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.266209 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":184,"threads_started":1}
I20260812 09:54:42.269070 32069 heartbeater.cc:347] Connected to a master server at 127.11.118.190:40521
I20260812 09:54:42.269356 32069 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:42.269984 32069 heartbeater.cc:511] Master 127.11.118.190:40521 requested a full tablet report, sending...
I20260812 09:54:42.271205 31702 ts_manager.cc:194] Registered new tserver with Master: 571dcd43cea54c45a7582d5f2ee378a9 (127.11.118.130:32893)
I20260812 09:54:42.271826 31702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.130:34851
W20260812 09:54:42.381531 32074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:42.381906 32074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:42.381979 32074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:42.386384 32074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:42.386458 32074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:42.386518 32074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:42.391597 32074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:42.392907 32074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:42.394362 32074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:42.404776 32084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:42.404841 32079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:42.404798 32081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:42.405050 32074 server_base.cc:1034] running on GCE node
I20260812 09:54:42.405691 32074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:42.406564 32074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:42.407757 32074 hybrid_clock.cc:648] HybridClock initialized: now 1786528482407710 us; error 69 us; skew 500 ppm
I20260812 09:54:42.410161 32074 webserver.cc:460] Webserver started at http://127.11.118.131:34089/ using document root <none> and password file <none>
I20260812 09:54:42.410845 32074 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:42.410923 32074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:42.411224 32074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:42.413581 32074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "65b3021f606c47ad8f4c664878f23f0e"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "80c8f393e77a4179e734fe48b2dc0062"
server_key_iv: "c9abc23df99afc01ee8bdc49f04d13f1"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.414227 32074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "65b3021f606c47ad8f4c664878f23f0e"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "80c8f393e77a4179e734fe48b2dc0062"
server_key_iv: "c9abc23df99afc01ee8bdc49f04d13f1"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.418577 32074 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:54:42.421530 32090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.423187 32074 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:42.423303 32074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "65b3021f606c47ad8f4c664878f23f0e"
format_stamp: "Formatted at 2026-08-12 09:54:42 on dist-test-slave-2w3w"
server_key: "80c8f393e77a4179e734fe48b2dc0062"
server_key_iv: "c9abc23df99afc01ee8bdc49f04d13f1"
server_key_version: "encryptionkey@0"
I20260812 09:54:42.423461 32074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:42.446461 32074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:42.447352 32074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:42.447610 32074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:42.448312 32074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:42.449404 32074 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:42.449457 32074 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.449502 32074 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:42.449517 32074 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:42.459547 32222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:41939 every 8 connection(s)
I20260812 09:54:42.459628 32074 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:41939
I20260812 09:54:42.460974 32074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:42.467231 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 32074
I20260812 09:54:42.467365 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:42.467724 11738 external_mini_cluster.cc:1428] Setting key aae2d9b9cd506b53cd1ed46298f62a48
I20260812 09:54:42.473213 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.463170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:40283 (local address 127.11.118.190:40521)
0812 09:54:42.463361 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.463365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.464599 (+ 1234us) server_negotiation.cc:407] Connection header received
0812 09:54:42.466130 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.466133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.466187 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.466315 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:42.467601 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.468341 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.470468 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.470754 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.470855 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.472508 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:42.472512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:42.472514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:42.472528 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:42.472550 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:42.472559 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:42.472633 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.472925 (+ 292us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.473005 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 09:54:42.474110 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.463654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40521 (local address 127.11.118.131:40283)
0812 09:54:42.464423 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.464475 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.465887 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.466526 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.466533 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.466622 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:42.467318 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.467335 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.468575 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.468579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.470251 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.470268 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.471011 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.471015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.471317 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.472162 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:42.472164 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:42.472213 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:42.472292 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:42.472677 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:42.472688 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:42.472693 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.472820 (+ 127us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.473099 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":135,"threads_started":1}
I20260812 09:54:42.476102 32223 heartbeater.cc:347] Connected to a master server at 127.11.118.190:40521
I20260812 09:54:42.476430 32223 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:42.477150 32223 heartbeater.cc:511] Master 127.11.118.190:40521 requested a full tablet report, sending...
I20260812 09:54:42.478451 31702 ts_manager.cc:194] Registered new tserver with Master: 65b3021f606c47ad8f4c664878f23f0e (127.11.118.131:41939)
I20260812 09:54:42.479220 31702 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.131:40283
I20260812 09:54:42.482818 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:42.489547 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.485163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.11.118.190:40521)
0812 09:54:42.485365 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.485369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.485615 (+ 246us) server_negotiation.cc:407] Connection header received
0812 09:54:42.485732 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.485734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.485788 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.485866 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:42.486174 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.486719 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.487680 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.487957 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.488054 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.489012 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:42.489016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:42.489018 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:42.489033 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:42.489064 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:42.489073 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:42.489143 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.489316 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.489406 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 09:54:42.493495 31702 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:42.496819 31702 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:42.513108 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.506445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:32893 (local address 127.0.0.1:55728)
0812 09:54:42.507112 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.507170 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.507301 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.508056 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.508062 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.508097 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:42.508287 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.508294 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.509979 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.509982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.511642 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.511656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512520 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.512524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.512646 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.512686 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.512793 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.512929 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":105,"spinlock_wait_cycles":5248,"thread_start_us":125,"threads_started":1}
I20260812 09:54:42.513108 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.506687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.11.118.130:32893)
0812 09:54:42.507499 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.507515 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.507544 (+ 29us) server_negotiation.cc:407] Connection header received
0812 09:54:42.507626 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.507631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.507851 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.508484 (+ 633us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:42.508650 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.509835 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.511815 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512387 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.512533 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.512757 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.512831 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.512935 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":188,"threads_started":1}
I20260812 09:54:42.513455 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.506651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:41939 (local address 127.0.0.1:53800)
0812 09:54:42.507981 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.507997 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.508103 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.508804 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.508807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.508826 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:42.508911 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.508918 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.509942 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.509947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.511660 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.511666 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512995 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.512998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.513120 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.513139 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.513212 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.513289 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1239,"mutex_wait_us":270,"spinlock_wait_cycles":7168,"thread_start_us":128,"threads_started":1}
I20260812 09:54:42.513736 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.507260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37197 (local address 127.0.0.1:55582)
0812 09:54:42.508279 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.508293 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.508385 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.508977 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.508982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.509002 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:42.509099 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.509106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.510363 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.510368 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.511668 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.511677 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512955 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.512962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.513056 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.513350 (+ 294us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.513416 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.513488 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":366,"thread_start_us":102,"threads_started":1}
I20260812 09:54:42.513978 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.507379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53800 (local address 127.11.118.131:41939)
0812 09:54:42.507731 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.507755 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.508370 (+ 615us) server_negotiation.cc:407] Connection header received
0812 09:54:42.508461 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.508467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.508653 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.508826 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:42.509014 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.509819 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.511798 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512625 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.512763 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.512942 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.513655 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.513791 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":110,"threads_started":1}
I20260812 09:54:42.514245 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.507710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55582 (local address 127.11.118.129:37197)
0812 09:54:42.508123 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.508135 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.508480 (+ 345us) server_negotiation.cc:407] Connection header received
0812 09:54:42.508551 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.508555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.508698 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.508826 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:42.509242 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.510249 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.511835 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.512625 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.513113 (+ 488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.513303 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.513954 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.514070 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":108,"threads_started":1}
I20260812 09:54:42.516517 32144 tablet_service.cc:1467] Processing CreateTablet for tablet f2d439b592c549b08bc100bad2759bf1 (DEFAULT_TABLE table=test-table [id=49ed41ae07504a8ca327101999a06357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:42.516516 31996 tablet_service.cc:1467] Processing CreateTablet for tablet f2d439b592c549b08bc100bad2759bf1 (DEFAULT_TABLE table=test-table [id=49ed41ae07504a8ca327101999a06357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:42.517591 31996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2d439b592c549b08bc100bad2759bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:42.517604 32144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2d439b592c549b08bc100bad2759bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:42.519397 31844 tablet_service.cc:1467] Processing CreateTablet for tablet f2d439b592c549b08bc100bad2759bf1 (DEFAULT_TABLE table=test-table [id=49ed41ae07504a8ca327101999a06357]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:42.520567 31844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2d439b592c549b08bc100bad2759bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:42.524932 32241 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Bootstrap starting.
I20260812 09:54:42.526626 32242 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Bootstrap starting.
I20260812 09:54:42.527563 32241 tablet_bootstrap.cc:654] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:42.528455 32241 log.cc:824] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:42.529131 32243 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: Bootstrap starting.
I20260812 09:54:42.529206 32242 tablet_bootstrap.cc:654] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:42.530156 32242 log.cc:824] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:42.531926 32243 tablet_bootstrap.cc:654] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:42.532078 32242 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: No bootstrap required, opened a new log
I20260812 09:54:42.532161 32241 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: No bootstrap required, opened a new log
I20260812 09:54:42.532330 32242 ts_tablet_manager.cc:1397] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:54:42.532377 32241 ts_tablet_manager.cc:1397] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 09:54:42.532914 32243 log.cc:824] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:42.535526 32243 tablet_bootstrap.cc:492] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: No bootstrap required, opened a new log
I20260812 09:54:42.535749 32243 ts_tablet_manager.cc:1397] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:54:42.536566 32242 raft_consensus.cc:348] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.536890 32242 raft_consensus.cc:374] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:42.536953 32242 raft_consensus.cc:729] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b3021f606c47ad8f4c664878f23f0e, State: Initialized, Role: FOLLOWER
I20260812 09:54:42.537006 32241 raft_consensus.cc:348] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.537292 32241 raft_consensus.cc:374] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:42.537355 32241 raft_consensus.cc:729] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571dcd43cea54c45a7582d5f2ee378a9, State: Initialized, Role: FOLLOWER
I20260812 09:54:42.537480 32242 consensus_queue.cc:260] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.537770 32241 consensus_queue.cc:260] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.538329 32223 heartbeater.cc:503] Master 127.11.118.190:40521 was elected leader, sending a full tablet report...
I20260812 09:54:42.538693 32242 ts_tablet_manager.cc:1428] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260812 09:54:42.538781 32241 ts_tablet_manager.cc:1428] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:54:42.539942 32069 heartbeater.cc:503] Master 127.11.118.190:40521 was elected leader, sending a full tablet report...
I20260812 09:54:42.540755 32248 raft_consensus.cc:482] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:42.540951 32248 raft_consensus.cc:504] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.541996 32243 raft_consensus.cc:348] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.542331 32243 raft_consensus.cc:374] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:42.542359 32248 leader_election.cc:288] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 571dcd43cea54c45a7582d5f2ee378a9 (127.11.118.130:32893), 9430be0dd962462f988a1f22003046fa (127.11.118.129:37197)
I20260812 09:54:42.542389 32243 raft_consensus.cc:729] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9430be0dd962462f988a1f22003046fa, State: Initialized, Role: FOLLOWER
I20260812 09:54:42.542874 32243 consensus_queue.cc:260] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.544194 31918 heartbeater.cc:503] Master 127.11.118.190:40521 was elected leader, sending a full tablet report...
I20260812 09:54:42.544377 32243 ts_tablet_manager.cc:1428] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260812 09:54:42.548538 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.544420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:39337 (local address 127.11.118.130:32893)
0812 09:54:42.544557 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.544561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.544575 (+ 14us) server_negotiation.cc:407] Connection header received
0812 09:54:42.544623 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.544626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.544678 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.544740 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:42.545084 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.545778 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.547179 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.547805 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.547961 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.548014 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.548269 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.548374 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 09:54:42.548574 32226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.543137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37197 (local address 127.11.118.131:50899)
0812 09:54:42.543549 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.543564 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.543658 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.544280 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.544284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.544303 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:42.544430 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.544439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.545730 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.545734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.547079 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.547106 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.548098 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.548101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.548205 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.548229 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.548309 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.548418 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":101,"spinlock_wait_cycles":4352,"thread_start_us":138,"threads_started":1}
I20260812 09:54:42.548918 32251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.542859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:32893 (local address 127.11.118.131:39337)
0812 09:54:42.543534 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.543552 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:42.543668 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:42.544789 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:42.544792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:42.544811 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:42.544939 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.544946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.545917 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.545923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.547023 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:42.547038 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.547968 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.547973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:42.548091 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.548135 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 09:54:42.548717 (+ 582us) client_negotiation.cc:240] Negotiation successful
0812 09:54:42.548801 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":27,"spinlock_wait_cycles":1792}
I20260812 09:54:42.549140 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.543893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:50899 (local address 127.11.118.129:37197)
0812 09:54:42.544007 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.544012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.544028 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:54:42.544079 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.544083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.544156 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.544241 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:42.544836 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.545598 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.547247 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.547856 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.547962 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.548014 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.548883 (+ 869us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.548982 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48,"spinlock_wait_cycles":31488}
I20260812 09:54:42.549590 32018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2d439b592c549b08bc100bad2759bf1" candidate_uuid: "65b3021f606c47ad8f4c664878f23f0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571dcd43cea54c45a7582d5f2ee378a9" is_pre_election: true
I20260812 09:54:42.549703 31868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2d439b592c549b08bc100bad2759bf1" candidate_uuid: "65b3021f606c47ad8f4c664878f23f0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9430be0dd962462f988a1f22003046fa" is_pre_election: true
I20260812 09:54:42.549963 31868 raft_consensus.cc:2454] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65b3021f606c47ad8f4c664878f23f0e in term 0.
I20260812 09:54:42.549964 32018 raft_consensus.cc:2454] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65b3021f606c47ad8f4c664878f23f0e in term 0.
I20260812 09:54:42.550743 32091 leader_election.cc:302] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 571dcd43cea54c45a7582d5f2ee378a9, 65b3021f606c47ad8f4c664878f23f0e; no voters:
I20260812 09:54:42.551055 32248 raft_consensus.cc:2781] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:42.551160 32248 raft_consensus.cc:482] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:42.551205 32248 raft_consensus.cc:3037] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:42.552327 32248 raft_consensus.cc:504] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.552778 32248 leader_election.cc:288] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [CANDIDATE]: Term 1 election: Requested vote from peers 571dcd43cea54c45a7582d5f2ee378a9 (127.11.118.130:32893), 9430be0dd962462f988a1f22003046fa (127.11.118.129:37197)
I20260812 09:54:42.553339 31868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2d439b592c549b08bc100bad2759bf1" candidate_uuid: "65b3021f606c47ad8f4c664878f23f0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9430be0dd962462f988a1f22003046fa"
I20260812 09:54:42.553341 32018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2d439b592c549b08bc100bad2759bf1" candidate_uuid: "65b3021f606c47ad8f4c664878f23f0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "571dcd43cea54c45a7582d5f2ee378a9"
I20260812 09:54:42.553506 32018 raft_consensus.cc:3037] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:42.553469 31868 raft_consensus.cc:3037] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:42.554646 32018 raft_consensus.cc:2454] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b3021f606c47ad8f4c664878f23f0e in term 1.
I20260812 09:54:42.554656 31868 raft_consensus.cc:2454] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b3021f606c47ad8f4c664878f23f0e in term 1.
I20260812 09:54:42.555160 32091 leader_election.cc:302] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65b3021f606c47ad8f4c664878f23f0e, 9430be0dd962462f988a1f22003046fa; no voters:
I20260812 09:54:42.555480 32248 raft_consensus.cc:2781] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:42.555796 32248 raft_consensus.cc:686] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 1 LEADER]: Becoming Leader. State: Replica: 65b3021f606c47ad8f4c664878f23f0e, State: Running, Role: LEADER
I20260812 09:54:42.556171 32248 consensus_queue.cc:237] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } }
I20260812 09:54:42.559563 31702 catalog_manager.cc:5495] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65b3021f606c47ad8f4c664878f23f0e (127.11.118.131). New cstate: current_term: 1 leader_uuid: "65b3021f606c47ad8f4c664878f23f0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b3021f606c47ad8f4c664878f23f0e" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 41939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 } health_report { overall_health: UNKNOWN } } }
I20260812 09:54:42.581053 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.576926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53806 (local address 127.11.118.131:41939)
0812 09:54:42.577091 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:42.577095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:42.577110 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:54:42.577196 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:42.577198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:42.577255 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:42.577350 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:42.577739 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.578320 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.579341 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:42.579574 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:42.579670 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:42.580087 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:42.580552 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:42.580659 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:42.580842 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 09:54:42.580900 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 09:54:42.588066 32018 raft_consensus.cc:1261] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 1 FOLLOWER]: Refusing update from remote peer 65b3021f606c47ad8f4c664878f23f0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:42.588066 31868 raft_consensus.cc:1261] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa [term 1 FOLLOWER]: Refusing update from remote peer 65b3021f606c47ad8f4c664878f23f0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:42.589223 32248 consensus_queue.cc:1035] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "571dcd43cea54c45a7582d5f2ee378a9" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 32893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:42.589494 32253 consensus_queue.cc:1035] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9430be0dd962462f988a1f22003046fa" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:42.598256 32259 mvcc.cc:205] Tried to move back new op lower bound from 7317620664671604736 to 7317620664552894464. Current Snapshot: MvccSnapshot[applied={T|T < 7317620664671604736}]
I20260812 09:54:42.608567 31702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:42.608754 31702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:42.611748 31702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61b801fe020646e09521a32b972e058e: Sending DeleteTablet for 3 replicas of tablet f2d439b592c549b08bc100bad2759bf1
I20260812 09:54:42.612773 32144 tablet_service.cc:1514] Processing DeleteTablet for tablet f2d439b592c549b08bc100bad2759bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:42 UTC) from {username='slave'} at 127.0.0.1:53800
I20260812 09:54:42.612823 31996 tablet_service.cc:1514] Processing DeleteTablet for tablet f2d439b592c549b08bc100bad2759bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:42 UTC) from {username='slave'} at 127.0.0.1:55728
I20260812 09:54:42.613036 31844 tablet_service.cc:1514] Processing DeleteTablet for tablet f2d439b592c549b08bc100bad2759bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:42 UTC) from {username='slave'} at 127.0.0.1:55582
I20260812 09:54:42.613642 32270 tablet_replica.cc:330] T f2d439b592c549b08bc100bad2759bf1 P 9430be0dd962462f988a1f22003046fa: stopping tablet replica
I20260812 09:54:42.613642 32267 tablet_replica.cc:330] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: stopping tablet replica
I20260812 09:54:42.614074 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31770
I20260812 09:54:42.618438 32267 raft_consensus.cc:2229] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:42.618778 32267 raft_consensus.cc:2258] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:42.619211 32268 tablet_replica.cc:330] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: stopping tablet replica
I20260812 09:54:42.619484 32268 raft_consensus.cc:2229] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:54:42.619801 32268 raft_consensus.cc:2258] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:42.621374 32267 ts_tablet_manager.cc:1905] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:42.621374 32268 ts_tablet_manager.cc:1905] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:42.624413 32267 ts_tablet_manager.cc:1918] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:42.624464 32268 ts_tablet_manager.cc:1918] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:42.624540 32267 log.cc:1196] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/f2d439b592c549b08bc100bad2759bf1
I20260812 09:54:42.624548 32268 log.cc:1196] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/f2d439b592c549b08bc100bad2759bf1
I20260812 09:54:42.624917 32267 ts_tablet_manager.cc:1939] T f2d439b592c549b08bc100bad2759bf1 P 571dcd43cea54c45a7582d5f2ee378a9: Deleting consensus metadata
I20260812 09:54:42.624933 32268 ts_tablet_manager.cc:1939] T f2d439b592c549b08bc100bad2759bf1 P 65b3021f606c47ad8f4c664878f23f0e: Deleting consensus metadata
I20260812 09:54:42.626292 31685 catalog_manager.cc:4841] TS 65b3021f606c47ad8f4c664878f23f0e (127.11.118.131:41939): tablet f2d439b592c549b08bc100bad2759bf1 (table test-table [id=49ed41ae07504a8ca327101999a06357]) successfully deleted
I20260812 09:54:42.626292 31683 catalog_manager.cc:4841] TS 571dcd43cea54c45a7582d5f2ee378a9 (127.11.118.130:32893): tablet f2d439b592c549b08bc100bad2759bf1 (table test-table [id=49ed41ae07504a8ca327101999a06357]) successfully deleted
W20260812 09:54:42.628216 31683 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:37197 (error 108)
I20260812 09:54:42.629127 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31921
I20260812 09:54:42.629464 32235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:42.629123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37197 (local address 127.0.0.1:55588)
0812 09:54:42.629295 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:42.629372 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:37197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260812 09:54:42.632302 31683 catalog_manager.cc:4584] TS 9430be0dd962462f988a1f22003046fa (127.11.118.129:37197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f2d439b592c549b08bc100bad2759bf1: Network error: Client connection negotiation failed: client connection to 127.11.118.129:37197: connect: Connection refused (error 111)
I20260812 09:54:42.638628 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 32074
I20260812 09:54:42.649437 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 31665
2026-08-12T09:54:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1118 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:42 dist-test-slave-2w3w krb5kdc[32274](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:42 dist-test-slave-2w3w krb5kdc[32274](info): set up 2 sockets
Aug 12 09:54:42 dist-test-slave-2w3w krb5kdc[32274](info): commencing operation
krb5kdc: starting...
W20260812 09:54:43.806151 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:43 dist-test-slave-2w3w krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:54:43.955631 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39145
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:39145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:44.080541 32290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:44.080868 32290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:44.080919 32290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:44.085238 32290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:44.085335 32290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:44.085356 32290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:44.085376 32290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:44.085392 32290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:44.092005 32290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:39145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:39145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:44.093688 32290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:44.094921 32290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:44.104359 32298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.104512 32295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.104512 32296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:44.104741 32290 server_base.cc:1034] running on GCE node
I20260812 09:54:44.105450 32290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:44.106693 32290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:44.107899 32290 hybrid_clock.cc:648] HybridClock initialized: now 1786528484107855 us; error 64 us; skew 500 ppm
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:44.115545 32290 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:54:44.116719 32290 webserver.cc:460] Webserver started at http://127.11.118.190:43705/ using document root <none> and password file <none>
I20260812 09:54:44.117304 32290 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:44.117372 32290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:44.117569 32290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:44.120569 32290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "2166eb9950fe4e35ab474c0b9a757a80"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "aa3b93f5908ca7e5960781138ac16b8b"
server_key_iv: "6800d63744850b748c3a914a81ccdce2"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.121248 32290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "2166eb9950fe4e35ab474c0b9a757a80"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "aa3b93f5908ca7e5960781138ac16b8b"
server_key_iv: "6800d63744850b748c3a914a81ccdce2"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.125612 32290 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:44.128521 32306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.130116 32290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:54:44.130250 32290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "2166eb9950fe4e35ab474c0b9a757a80"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "aa3b93f5908ca7e5960781138ac16b8b"
server_key_iv: "6800d63744850b748c3a914a81ccdce2"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.130445 32290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:44.148813 32290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:44.152462 32290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:44.152688 32290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:44.160759 32290 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:39145
I20260812 09:54:44.160784 32366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:39145 every 8 connection(s)
I20260812 09:54:44.161795 32290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:44.164798 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 32290
I20260812 09:54:44.164919 32367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:44.164953 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:44.165282 11738 external_mini_cluster.cc:1428] Setting key 8011b9dfbaa68dcfbc2dab39a0eb41a1
I20260812 09:54:44.172643 32367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: Bootstrap starting.
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:44.176118 32367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:44.176939 32367 log.cc:824] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:44.179435 32367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: No bootstrap required, opened a new log
I20260812 09:54:44.182539 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.166795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33950 (local address 127.11.118.190:39145)
0812 09:54:44.167376 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:44.167392 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:44.167432 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:54:44.168202 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:44.168221 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:44.168593 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:44.168902 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:44.169963 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.171162 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.172475 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.173147 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.173298 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.176721 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:44.176728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:44.176743 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:44.176778 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:44.179188 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.179797 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.179803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.179808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.179946 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.180284 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.180288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.180291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.180761 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:44.180995 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:44.181364 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 09:54:44.181710 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":252,"threads_started":1}
I20260812 09:54:44.183396 32367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } }
I20260812 09:54:44.183660 32367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:44.183717 32367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2166eb9950fe4e35ab474c0b9a757a80, State: Initialized, Role: FOLLOWER
I20260812 09:54:44.184149 32367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } }
I20260812 09:54:44.184314 32367 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:44.184403 32367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:44.184530 32367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:44.185664 32367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } }
I20260812 09:54:44.186010 32367 leader_election.cc:302] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2166eb9950fe4e35ab474c0b9a757a80; no voters:
I20260812 09:54:44.186334 32367 leader_election.cc:288] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:44.186554 32373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:44.186879 32373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [term 1 LEADER]: Becoming Leader. State: Replica: 2166eb9950fe4e35ab474c0b9a757a80, State: Running, Role: LEADER
I20260812 09:54:44.187314 32373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } }
I20260812 09:54:44.187649 32367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:44.189208 32374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2166eb9950fe4e35ab474c0b9a757a80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } } }
I20260812 09:54:44.189366 32374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:44.189246 32375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2166eb9950fe4e35ab474c0b9a757a80. Latest consensus state: current_term: 1 leader_uuid: "2166eb9950fe4e35ab474c0b9a757a80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166eb9950fe4e35ab474c0b9a757a80" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 39145 } } }
I20260812 09:54:44.189666 32375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:44.190563 32386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:44.193909 32386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:44.200632 32386 catalog_manager.cc:1347] Generated new cluster ID: f17b3430eb894a768647ed1f931d15c6
I20260812 09:54:44.200729 32386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:44.214038 32386 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:44.215268 32386 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:44.226625 32386 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: Generated new TSK 0
I20260812 09:54:44.227514 32386 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:54:44.267334 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:44.395344 32395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:44.395635 32395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:44.395684 32395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:44.399857 32395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:44.399926 32395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:44.399991 32395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:44.405889 32395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:44.406952 32395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:44.408082 32395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:44.419323 32401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.419335 32404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.419335 32402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:44.419734 32395 server_base.cc:1034] running on GCE node
I20260812 09:54:44.420228 32395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:44.420943 32395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:44.422142 32395 hybrid_clock.cc:648] HybridClock initialized: now 1786528484422127 us; error 28 us; skew 500 ppm
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:44.425220 32395 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:54:44.426244 32395 webserver.cc:460] Webserver started at http://127.11.118.129:46561/ using document root <none> and password file <none>
I20260812 09:54:44.426848 32395 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:44.426944 32395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:44.427193 32395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:44.429414 32395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "b19b0d394d0749a08990144a8aa6004a"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6ba2f23b140d3553c5e96d6814298c47"
server_key_iv: "86ce55f8064cce022f99d229fa2e52c1"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.430012 32395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "b19b0d394d0749a08990144a8aa6004a"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6ba2f23b140d3553c5e96d6814298c47"
server_key_iv: "86ce55f8064cce022f99d229fa2e52c1"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.434082 32395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 09:54:44.436966 32412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.438558 32395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 09:54:44.438740 32395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "b19b0d394d0749a08990144a8aa6004a"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6ba2f23b140d3553c5e96d6814298c47"
server_key_iv: "86ce55f8064cce022f99d229fa2e52c1"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.438875 32395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:44.455560 32395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:44.459218 32395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:44.459403 32395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:44.460003 32395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:44.460831 32395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:44.460893 32395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.460937 32395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:44.460958 32395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.470479 32395 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:45287
I20260812 09:54:44.470504 32548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:45287 every 8 connection(s)
I20260812 09:54:44.471586 32395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:44.476398 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 32395
I20260812 09:54:44.476550 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:44.476876 11738 external_mini_cluster.cc:1428] Setting key 4188d8113e271f79efc347423e03a66d
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:54:44.488934 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.473570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:47383 (local address 127.11.118.190:39145)
0812 09:54:44.473750 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:44.473754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:44.474698 (+ 944us) server_negotiation.cc:407] Connection header received
0812 09:54:44.476243 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:44.476249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:44.476319 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:44.476432 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:44.477983 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.478663 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.480157 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.480602 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.480753 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.484078 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:44.484084 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:44.484089 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:44.484125 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:44.485894 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.486683 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.486686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.486688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.486874 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.487430 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.487433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.487434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.487658 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:44.487744 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:44.488593 (+ 849us) server_negotiation.cc:299] Negotiation successful
0812 09:54:44.488775 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:54:44.489912 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.473975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39145 (local address 127.11.118.129:47383)
0812 09:54:44.474467 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:44.474565 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:44.476004 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:44.476667 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:44.476674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:44.477160 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:44.477765 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.477779 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.478856 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.478859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.480013 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.480025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.480880 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.480888 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.481145 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.481863 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:44.481890 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:44.483807 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:44.486059 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.486070 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.486094 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.486524 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.487033 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.487036 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.487038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.487260 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.487783 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:44.487792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:44.488210 (+ 418us) client_negotiation.cc:769] Sending connection context
0812 09:54:44.488454 (+ 244us) client_negotiation.cc:240] Negotiation successful
0812 09:54:44.488890 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":130,"threads_started":1}
I20260812 09:54:44.491621 32550 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39145
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:54:44.492036 32550 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:44.492679 32550 heartbeater.cc:511] Master 127.11.118.190:39145 requested a full tablet report, sending...
I20260812 09:54:44.494863 32324 ts_manager.cc:194] Registered new tserver with Master: b19b0d394d0749a08990144a8aa6004a (127.11.118.129:45287)
I20260812 09:54:44.497423 32324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:47383
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:54:44.515774 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:44.644667 32556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:44.644973 32556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:44.645020 32556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:44.649783 32556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:44.649893 32556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:44.649962 32556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:44.656390 32556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:44.657645 32556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:44.658736 32556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:54:44.669523 32556 server_base.cc:1034] running on GCE node
W20260812 09:54:44.669436 32567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.669430 32565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.669430 32564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:44.670282 32556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:44.671324 32556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:44.672526 32556 hybrid_clock.cc:648] HybridClock initialized: now 1786528484672444 us; error 102 us; skew 500 ppm
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:44.676218 32556 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:54:44.677253 32556 webserver.cc:460] Webserver started at http://127.11.118.130:40017/ using document root <none> and password file <none>
I20260812 09:54:44.677886 32556 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:44.677965 32556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:44.678201 32556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:44.680528 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "59a87fc2e7b147dd88bdd6ee83ea250d"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6a90dacbfebc2e48656ecfaeaa9bf940"
server_key_iv: "bd4426952d98dab65b22eb72c8a01ebe"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.681186 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "59a87fc2e7b147dd88bdd6ee83ea250d"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6a90dacbfebc2e48656ecfaeaa9bf940"
server_key_iv: "bd4426952d98dab65b22eb72c8a01ebe"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.685458 32556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:44.688306 32577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.690042 32556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:44.690207 32556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "59a87fc2e7b147dd88bdd6ee83ea250d"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "6a90dacbfebc2e48656ecfaeaa9bf940"
server_key_iv: "bd4426952d98dab65b22eb72c8a01ebe"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.690371 32556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:44.708631 32556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:44.712440 32556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:44.712672 32556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:44.713339 32556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:44.714231 32556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:44.714313 32556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.714390 32556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:44.714435 32556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.724820 32556 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45789
I20260812 09:54:44.724851 32710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45789 every 8 connection(s)
I20260812 09:54:44.725776 32556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:44.735085 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 32556
I20260812 09:54:44.735273 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:44.735580 11738 external_mini_cluster.cc:1428] Setting key 40baf0e1d49604624f44e58480b1d36a
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:44.741979 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.727967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:32949 (local address 127.11.118.190:39145)
0812 09:54:44.728149 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:44.728154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:44.729055 (+ 901us) server_negotiation.cc:407] Connection header received
0812 09:54:44.730509 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:44.730512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:44.730569 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:44.730653 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:44.732243 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.732868 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.734212 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.734462 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.734605 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.738032 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:44.738035 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:44.738038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:44.738065 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:44.739623 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.740262 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.740269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.740271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.740362 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.740757 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.740760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.740762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.740969 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:44.741083 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:44.741657 (+ 574us) server_negotiation.cc:299] Negotiation successful
0812 09:54:44.741811 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 09:54:44.742928 32714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.728327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39145 (local address 127.11.118.130:32949)
0812 09:54:44.728880 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:44.728927 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:44.730251 (+ 1324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:44.730941 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:44.730949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:44.731459 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:44.732034 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.732051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.733028 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.733031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.734039 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.734050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.734663 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.734667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.735045 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.735960 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:44.735985 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:44.737831 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:44.739777 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.739786 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.739807 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.740138 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.740465 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.740468 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.740470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.740638 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.741085 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:44.741095 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:44.741399 (+ 304us) client_negotiation.cc:769] Sending connection context
0812 09:54:44.741612 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 09:54:44.741996 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":117,"threads_started":1}
I20260812 09:54:44.744453 32711 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39145
I20260812 09:54:44.744746 32711 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:44.745440 32711 heartbeater.cc:511] Master 127.11.118.190:39145 requested a full tablet report, sending...
I20260812 09:54:44.746810 32324 ts_manager.cc:194] Registered new tserver with Master: 59a87fc2e7b147dd88bdd6ee83ea250d (127.11.118.130:45789)
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:54:44.747561 32324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:32949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:54:44.771409 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:44.901158 32718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:44.901470 32718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:44.901517 32718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:44.905860 32718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:44.905947 32718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:44.906052 32718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:44.912176 32718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:39145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:44.913408 32718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:44.914536 32718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:44.925446 32726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:44.925540 32718 server_base.cc:1034] running on GCE node
W20260812 09:54:44.925453 32723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:44.925463 32724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:44.926229 32718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:44.927009 32718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:44.928206 32718 hybrid_clock.cc:648] HybridClock initialized: now 1786528484928151 us; error 72 us; skew 500 ppm
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:44.931784 32718 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:54:44.932940 32718 webserver.cc:460] Webserver started at http://127.11.118.131:41525/ using document root <none> and password file <none>
I20260812 09:54:44.933564 32718 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:44.933667 32718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:44.933925 32718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:44.936333 32718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "708fea660da4478485d7e75ff93ad675"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "d229a00c94863b9a13d5c6348a76b43c"
server_key_iv: "40c0fe3a4f3ea4a7d886db430c220b83"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.936957 32718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "708fea660da4478485d7e75ff93ad675"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "d229a00c94863b9a13d5c6348a76b43c"
server_key_iv: "40c0fe3a4f3ea4a7d886db430c220b83"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.941247 32718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:44.944756 32736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.946408 32718 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260812 09:54:44.946614 32718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "708fea660da4478485d7e75ff93ad675"
format_stamp: "Formatted at 2026-08-12 09:54:44 on dist-test-slave-2w3w"
server_key: "d229a00c94863b9a13d5c6348a76b43c"
server_key_iv: "40c0fe3a4f3ea4a7d886db430c220b83"
server_key_version: "encryptionkey@0"
I20260812 09:54:44.946763 32718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:44.956588 32718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:44.960804 32718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:44.961035 32718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:44.961690 32718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:44.962617 32718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:44.962692 32718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.962774 32718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:44.962828 32718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:44.974493 32718 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:34805
I20260812 09:54:44.974596 400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:34805 every 8 connection(s)
I20260812 09:54:44.975709 32718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:44.980940 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 32718
I20260812 09:54:44.981148 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:44.981451 11738 external_mini_cluster.cc:1428] Setting key f8038a26beac11b039ffec1ea05c9e16
Aug 12 09:54:44 dist-test-slave-2w3w krb5kdc[32274](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528484, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:44.992995 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.977967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:55829 (local address 127.11.118.190:39145)
0812 09:54:44.978153 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:44.978156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:44.979528 (+ 1372us) server_negotiation.cc:407] Connection header received
0812 09:54:44.981057 (+ 1529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:44.981061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:44.981128 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:44.981216 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:44.982755 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.983417 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.984665 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.984912 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.985029 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.988104 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:44.988108 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:44.988110 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:44.988141 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:44.990505 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.991258 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.991263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.991265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.991362 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:44.991770 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:44.991773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:44.991775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:44.991987 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:44.992099 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:44.992665 (+ 566us) server_negotiation.cc:299] Negotiation successful
0812 09:54:44.992821 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 09:54:44.993880 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:44.978316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:39145 (local address 127.11.118.131:55829)
0812 09:54:44.979327 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:44.979384 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:44.980770 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:44.981440 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:44.981449 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:44.981966 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:44.982580 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.982603 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.983557 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.983560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.984523 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:44.984534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:44.985082 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:44.985087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:44.985277 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:44.985960 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:44.985978 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:44.987839 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:44.990685 (+ 2846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.990692 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.990719 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.991138 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.991469 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:44.991472 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:44.991474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:44.991655 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:44.992099 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:44.992108 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:44.992406 (+ 298us) client_negotiation.cc:769] Sending connection context
0812 09:54:44.992606 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 09:54:44.992983 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":130,"threads_started":1}
I20260812 09:54:44.995610 401 heartbeater.cc:347] Connected to a master server at 127.11.118.190:39145
I20260812 09:54:44.995940 401 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:44.997012 401 heartbeater.cc:511] Master 127.11.118.190:39145 requested a full tablet report, sending...
I20260812 09:54:44.999267 32324 ts_manager.cc:194] Registered new tserver with Master: 708fea660da4478485d7e75ff93ad675 (127.11.118.131:34805)
I20260812 09:54:45.000217 32324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:55829
I20260812 09:54:45.009547 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:45.023942 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.012113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33966 (local address 127.11.118.190:39145)
0812 09:54:45.012279 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.012284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.012415 (+ 131us) server_negotiation.cc:407] Connection header received
0812 09:54:45.012509 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.012511 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.012568 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.012649 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:45.013948 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.014551 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.016307 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.016575 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.016697 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.019246 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:45.019249 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:45.019251 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:45.019281 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:45.021022 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:45.021681 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:45.021684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:45.021685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:45.021769 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:45.022418 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:45.022423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:45.022424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:45.022818 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:45.023151 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.023485 (+ 334us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.023681 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:54:45.027637 32324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33966:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:45.031149 32324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:45.050144 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.042229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44134 (local address 127.11.118.131:34805)
0812 09:54:45.042974 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.043018 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.043041 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:54:45.043131 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.043136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.043282 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.043462 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:45.043846 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045057 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.047737 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.048749 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.048895 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.049049 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.049853 (+ 804us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.049981 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":95,"threads_started":1}
I20260812 09:54:45.050448 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.042245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44828 (local address 127.11.118.129:45287)
0812 09:54:45.043211 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.043217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.043240 (+ 23us) server_negotiation.cc:407] Connection header received
0812 09:54:45.043314 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.043318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.043493 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.043649 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:45.044164 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045186 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.047738 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.048749 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.048902 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.049049 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.050148 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.050295 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":105,"threads_started":1}
I20260812 09:54:45.050935 415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.041752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:34805 (local address 127.0.0.1:44134)
0812 09:54:45.042627 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.042641 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.042707 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.043604 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.043607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.043624 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:45.043727 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.043732 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045548 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.045552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.047555 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.047568 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.049136 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.049140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.049440 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.049540 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.049678 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.050766 (+ 1088us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":1046,"thread_start_us":98,"threads_started":1}
I20260812 09:54:45.051463 416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.041541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.11.118.130:45789)
0812 09:54:45.042015 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.042038 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.042504 (+ 466us) server_negotiation.cc:407] Connection header received
0812 09:54:45.042841 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.042849 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.043114 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.043257 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:45.043943 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045524 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.047582 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.048734 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.048878 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.049049 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.051126 (+ 2077us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.051297 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":133,"threads_started":1}
I20260812 09:54:45.051054 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.041539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:45287 (local address 127.0.0.1:44828)
0812 09:54:45.042584 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.042597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.042694 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.043785 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.043791 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.043809 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:45.044002 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.044012 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045422 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.045426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.047555 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.047568 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.049136 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.049140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.049526 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.049548 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.049678 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.049866 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":508,"thread_start_us":139,"threads_started":1}
I20260812 09:54:45.051338 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.041342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45789 (local address 127.0.0.1:50700)
0812 09:54:45.042294 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.042405 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.042620 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.043520 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.043527 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.043557 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:45.043723 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.043732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.045771 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.045776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.047398 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.047414 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.049163 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.049170 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.050713 (+ 1543us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.050743 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.050836 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.050926 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"mutex_wait_us":1356,"thread_start_us":107,"threads_started":1}
I20260812 09:54:45.055018 319 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 (DEFAULT_TABLE table=test-table [id=b3f26e8c68bb4ec398894bacf04abb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:45.055017 32468 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 (DEFAULT_TABLE table=test-table [id=b3f26e8c68bb4ec398894bacf04abb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:45.055373 32630 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 (DEFAULT_TABLE table=test-table [id=b3f26e8c68bb4ec398894bacf04abb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:45.056433 319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4443a8d4f44db395f3fd2f1e58fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:45.056433 32468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4443a8d4f44db395f3fd2f1e58fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:45.056514 32630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4443a8d4f44db395f3fd2f1e58fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:45.065150 422 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Bootstrap starting.
I20260812 09:54:45.065213 424 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Bootstrap starting.
I20260812 09:54:45.067303 422 tablet_bootstrap.cc:654] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:45.067314 424 tablet_bootstrap.cc:654] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:45.067373 423 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: Bootstrap starting.
I20260812 09:54:45.068703 422 log.cc:824] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:45.068702 424 log.cc:824] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:45.069900 423 tablet_bootstrap.cc:654] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:45.070681 423 log.cc:824] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:45.071328 422 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: No bootstrap required, opened a new log
I20260812 09:54:45.071589 422 ts_tablet_manager.cc:1397] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260812 09:54:45.072225 424 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: No bootstrap required, opened a new log
I20260812 09:54:45.072422 424 ts_tablet_manager.cc:1397] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260812 09:54:45.072881 423 tablet_bootstrap.cc:492] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: No bootstrap required, opened a new log
I20260812 09:54:45.073058 423 ts_tablet_manager.cc:1397] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260812 09:54:45.075302 422 raft_consensus.cc:348] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.075632 422 raft_consensus.cc:374] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:45.075709 422 raft_consensus.cc:729] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a87fc2e7b147dd88bdd6ee83ea250d, State: Initialized, Role: FOLLOWER
I20260812 09:54:45.076272 422 consensus_queue.cc:260] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.076550 424 raft_consensus.cc:348] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.076813 424 raft_consensus.cc:374] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:45.076885 424 raft_consensus.cc:729] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 708fea660da4478485d7e75ff93ad675, State: Initialized, Role: FOLLOWER
I20260812 09:54:45.077199 32711 heartbeater.cc:503] Master 127.11.118.190:39145 was elected leader, sending a full tablet report...
I20260812 09:54:45.077304 424 consensus_queue.cc:260] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.077493 422 ts_tablet_manager.cc:1428] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:54:45.077625 423 raft_consensus.cc:348] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.077893 423 raft_consensus.cc:374] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:45.077956 423 raft_consensus.cc:729] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b19b0d394d0749a08990144a8aa6004a, State: Initialized, Role: FOLLOWER
I20260812 09:54:45.078352 424 ts_tablet_manager.cc:1428] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 09:54:45.078353 401 heartbeater.cc:503] Master 127.11.118.190:39145 was elected leader, sending a full tablet report...
I20260812 09:54:45.078600 423 consensus_queue.cc:260] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.079393 32550 heartbeater.cc:503] Master 127.11.118.190:39145 was elected leader, sending a full tablet report...
I20260812 09:54:45.080192 423 ts_tablet_manager.cc:1428] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:54:45.114852 429 raft_consensus.cc:482] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:45.115171 429 raft_consensus.cc:504] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.116389 429 leader_election.cc:288] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59a87fc2e7b147dd88bdd6ee83ea250d (127.11.118.130:45789), b19b0d394d0749a08990144a8aa6004a (127.11.118.129:45287)
I20260812 09:54:45.121699 403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.116691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:45287 (local address 127.11.118.131:58451)
0812 09:54:45.116873 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.116891 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.116995 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.117382 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.117385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.117401 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:45.117626 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.117635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.118684 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.118687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.120088 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.120100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.121133 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.121137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.121263 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.121291 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.121392 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.121541 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 09:54:45.121699 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.116839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:58451 (local address 127.11.118.129:45287)
0812 09:54:45.116983 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.116988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.117009 (+ 21us) server_negotiation.cc:407] Connection header received
0812 09:54:45.117086 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.117089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.117153 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.117321 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:45.117763 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.118531 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.120247 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.120965 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.121132 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.121190 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.121424 (+ 234us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.121533 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 09:54:45.121754 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.116699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45789 (local address 127.11.118.131:45531)
0812 09:54:45.117442 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.117456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.117608 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.117959 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.117962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.117981 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:45.118146 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.118153 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.119041 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.119044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.120225 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.120236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.121290 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.121295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.121405 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.121431 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.121512 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.121614 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":314,"thread_start_us":155,"threads_started":1}
I20260812 09:54:45.121831 416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.116855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:45531 (local address 127.11.118.130:45789)
0812 09:54:45.116983 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.116988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.117533 (+ 545us) server_negotiation.cc:407] Connection header received
0812 09:54:45.117729 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.117733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.117802 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.117910 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:45.118284 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.118894 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.120365 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.121063 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.121169 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.121218 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.121579 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.121677 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 09:54:45.122589 32489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4443a8d4f44db395f3fd2f1e58fe71" candidate_uuid: "708fea660da4478485d7e75ff93ad675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19b0d394d0749a08990144a8aa6004a" is_pre_election: true
I20260812 09:54:45.122810 32656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4443a8d4f44db395f3fd2f1e58fe71" candidate_uuid: "708fea660da4478485d7e75ff93ad675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" is_pre_election: true
I20260812 09:54:45.123003 32489 raft_consensus.cc:2454] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 708fea660da4478485d7e75ff93ad675 in term 0.
I20260812 09:54:45.123165 32656 raft_consensus.cc:2454] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 708fea660da4478485d7e75ff93ad675 in term 0.
I20260812 09:54:45.123660 32737 leader_election.cc:302] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 708fea660da4478485d7e75ff93ad675, b19b0d394d0749a08990144a8aa6004a; no voters:
I20260812 09:54:45.124003 429 raft_consensus.cc:2781] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:45.124106 429 raft_consensus.cc:482] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:45.124157 429 raft_consensus.cc:3037] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:45.125366 429 raft_consensus.cc:504] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.125768 429 leader_election.cc:288] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [CANDIDATE]: Term 1 election: Requested vote from peers 59a87fc2e7b147dd88bdd6ee83ea250d (127.11.118.130:45789), b19b0d394d0749a08990144a8aa6004a (127.11.118.129:45287)
I20260812 09:54:45.126185 32656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4443a8d4f44db395f3fd2f1e58fe71" candidate_uuid: "708fea660da4478485d7e75ff93ad675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d"
I20260812 09:54:45.126231 32489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4443a8d4f44db395f3fd2f1e58fe71" candidate_uuid: "708fea660da4478485d7e75ff93ad675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b19b0d394d0749a08990144a8aa6004a"
I20260812 09:54:45.126356 32656 raft_consensus.cc:3037] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:45.126377 32489 raft_consensus.cc:3037] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:45.127687 32489 raft_consensus.cc:2454] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 708fea660da4478485d7e75ff93ad675 in term 1.
I20260812 09:54:45.127691 32656 raft_consensus.cc:2454] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 708fea660da4478485d7e75ff93ad675 in term 1.
I20260812 09:54:45.128106 32737 leader_election.cc:302] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 708fea660da4478485d7e75ff93ad675, b19b0d394d0749a08990144a8aa6004a; no voters:
I20260812 09:54:45.128334 429 raft_consensus.cc:2781] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:45.128633 429 raft_consensus.cc:686] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 1 LEADER]: Becoming Leader. State: Replica: 708fea660da4478485d7e75ff93ad675, State: Running, Role: LEADER
I20260812 09:54:45.129053 429 consensus_queue.cc:237] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } }
I20260812 09:54:45.132498 32324 catalog_manager.cc:5495] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 708fea660da4478485d7e75ff93ad675 (127.11.118.131). New cstate: current_term: 1 leader_uuid: "708fea660da4478485d7e75ff93ad675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "708fea660da4478485d7e75ff93ad675" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 34805 } health_report { overall_health: HEALTHY } } }
I20260812 09:54:45.164974 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.160103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.11.118.131:34805)
0812 09:54:45.160263 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.160270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.160289 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:54:45.160383 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.160386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.160474 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.160604 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:45.160959 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.161757 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.162918 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.163279 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.163404 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.163741 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:45.164360 (+ 619us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:45.164591 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.164747 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.164794 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:54:45.172292 32656 raft_consensus.cc:1261] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 1 FOLLOWER]: Refusing update from remote peer 708fea660da4478485d7e75ff93ad675: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:45.172282 32489 raft_consensus.cc:1261] T 9c4443a8d4f44db395f3fd2f1e58fe71 P b19b0d394d0749a08990144a8aa6004a [term 1 FOLLOWER]: Refusing update from remote peer 708fea660da4478485d7e75ff93ad675: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:45.173439 432 consensus_queue.cc:1035] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b19b0d394d0749a08990144a8aa6004a" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 45287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:45.174047 429 consensus_queue.cc:1035] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59a87fc2e7b147dd88bdd6ee83ea250d" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:45.182747 438 mvcc.cc:205] Tried to move back new op lower bound from 7317620675256209408 to 7317620675091423232. Current Snapshot: MvccSnapshot[applied={T|T < 7317620675256209408}]
I20260812 09:54:45.184260 439 mvcc.cc:205] Tried to move back new op lower bound from 7317620675256209408 to 7317620675091423232. Current Snapshot: MvccSnapshot[applied={T|T < 7317620675256209408}]
I20260812 09:54:45.195986 32323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:45.196252 32323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33966:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:45.200775 32323 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2166eb9950fe4e35ab474c0b9a757a80: Sending DeleteTablet for 3 replicas of tablet 9c4443a8d4f44db395f3fd2f1e58fe71
I20260812 09:54:45.202207 32468 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:45 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:44828
I20260812 09:54:45.202207 319 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:45 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:44134
I20260812 09:54:45.203405 448 tablet_replica.cc:330] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: stopping tablet replica
I20260812 09:54:45.203474 32630 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c4443a8d4f44db395f3fd2f1e58fe71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:45 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:50700
I20260812 09:54:45.203887 448 raft_consensus.cc:2229] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:54:45.204139 449 tablet_replica.cc:330] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: stopping tablet replica
I20260812 09:54:45.204416 448 raft_consensus.cc:2258] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:45.204594 449 raft_consensus.cc:2229] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:45.204988 449 raft_consensus.cc:2258] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:45.205395 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 32395
I20260812 09:54:45.206481 448 ts_tablet_manager.cc:1905] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:45.208376 449 ts_tablet_manager.cc:1905] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:45.209684 448 ts_tablet_manager.cc:1918] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:45.209817 448 log.cc:1196] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/9c4443a8d4f44db395f3fd2f1e58fe71
I20260812 09:54:45.210170 448 ts_tablet_manager.cc:1939] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 708fea660da4478485d7e75ff93ad675: Deleting consensus metadata
I20260812 09:54:45.211890 32308 catalog_manager.cc:4841] TS 708fea660da4478485d7e75ff93ad675 (127.11.118.131:34805): tablet 9c4443a8d4f44db395f3fd2f1e58fe71 (table test-table [id=b3f26e8c68bb4ec398894bacf04abb5f]) successfully deleted
I20260812 09:54:45.212579 449 ts_tablet_manager.cc:1918] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:45.212790 449 log.cc:1196] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/9c4443a8d4f44db395f3fd2f1e58fe71
I20260812 09:54:45.213320 449 ts_tablet_manager.cc:1939] T 9c4443a8d4f44db395f3fd2f1e58fe71 P 59a87fc2e7b147dd88bdd6ee83ea250d: Deleting consensus metadata
I20260812 09:54:45.214773 32310 catalog_manager.cc:4841] TS 59a87fc2e7b147dd88bdd6ee83ea250d (127.11.118.130:45789): tablet 9c4443a8d4f44db395f3fd2f1e58fe71 (table test-table [id=b3f26e8c68bb4ec398894bacf04abb5f]) successfully deleted
W20260812 09:54:45.218387 32307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:45287 (error 108)
I20260812 09:54:45.218474 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 32556
I20260812 09:54:45.222476 415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.221763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:45287 (local address 127.0.0.1:44836)
0812 09:54:45.222082 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.222369 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:45287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
W20260812 09:54:45.222762 32307 catalog_manager.cc:4584] TS b19b0d394d0749a08990144a8aa6004a (127.11.118.129:45287): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c4443a8d4f44db395f3fd2f1e58fe71: Network error: Client connection negotiation failed: client connection to 127.11.118.129:45287: connect: Connection refused (error 111)
I20260812 09:54:45.229796 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 32718
I20260812 09:54:45.239981 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 32290
2026-08-12T09:54:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2595 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T09:54:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:45Z Disabled control of system clock
I20260812 09:54:45.282430 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:34241
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:34241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:45.407823 456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:45.408160 456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:45.408200 456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:45.413332 456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:45.413435 456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:45.413455 456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:45.413475 456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:45.413494 456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:45.419407 456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:34241
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:34241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:45.420608 456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:45.422020 456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:45.431712 466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:45.431712 463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:45.431762 456 server_base.cc:1034] running on GCE node
W20260812 09:54:45.431795 464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:45.432898 456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:45.434168 456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:45.435477 456 hybrid_clock.cc:648] HybridClock initialized: now 1786528485435459 us; error 35 us; skew 500 ppm
I20260812 09:54:45.437714 456 webserver.cc:460] Webserver started at http://127.11.118.190:40439/ using document root <none> and password file <none>
I20260812 09:54:45.438428 456 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:45.438560 456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:45.438828 456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:45.441239 456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "e663d9e9d88f49fbbbfef7234b15d7ab"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "4a8856805f837471257c7c2d5a877b2c"
server_key_iv: "49ca34c8c2a0e12cd28609cc4b206adb"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.441918 456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "e663d9e9d88f49fbbbfef7234b15d7ab"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "4a8856805f837471257c7c2d5a877b2c"
server_key_iv: "49ca34c8c2a0e12cd28609cc4b206adb"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.446362 456 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260812 09:54:45.449496 472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.451227 456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 09:54:45.451419 456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "e663d9e9d88f49fbbbfef7234b15d7ab"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "4a8856805f837471257c7c2d5a877b2c"
server_key_iv: "49ca34c8c2a0e12cd28609cc4b206adb"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.451566 456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:45.481721 456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:45.482631 456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:45.482895 456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:45.492084 456 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:34241
I20260812 09:54:45.492101 532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:34241 every 8 connection(s)
I20260812 09:54:45.493173 456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:45.496752 533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:45.501188 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 456
I20260812 09:54:45.501389 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:45.501701 11738 external_mini_cluster.cc:1428] Setting key 60a27caa75a95e5b0f56560770ad5106
I20260812 09:54:45.503634 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: Bootstrap starting.
I20260812 09:54:45.506045 533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:45.506891 533 log.cc:824] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:45.509019 533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: No bootstrap required, opened a new log
I20260812 09:54:45.512635 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.503407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50936 (local address 127.11.118.190:34241)
0812 09:54:45.504176 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.504194 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.504234 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:54:45.504953 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.504972 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.505387 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.505830 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:45.506356 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.507446 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.508368 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.508880 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.509225 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.510542 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:45.510548 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:45.510565 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:45.511109 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:45.511178 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:45.511202 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:45.511320 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.511478 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.511814 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":157,"threads_started":1}
I20260812 09:54:45.513203 533 raft_consensus.cc:348] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } }
I20260812 09:54:45.513481 533 raft_consensus.cc:374] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:45.513549 533 raft_consensus.cc:729] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e663d9e9d88f49fbbbfef7234b15d7ab, State: Initialized, Role: FOLLOWER
I20260812 09:54:45.514051 533 consensus_queue.cc:260] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } }
I20260812 09:54:45.514240 533 raft_consensus.cc:388] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:45.514325 533 raft_consensus.cc:482] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:45.514456 533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:45.515676 533 raft_consensus.cc:504] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } }
I20260812 09:54:45.516033 533 leader_election.cc:302] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e663d9e9d88f49fbbbfef7234b15d7ab; no voters:
I20260812 09:54:45.516376 533 leader_election.cc:288] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:45.516542 539 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:45.516783 539 raft_consensus.cc:686] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [term 1 LEADER]: Becoming Leader. State: Replica: e663d9e9d88f49fbbbfef7234b15d7ab, State: Running, Role: LEADER
I20260812 09:54:45.517128 539 consensus_queue.cc:237] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } }
I20260812 09:54:45.517634 533 sys_catalog.cc:564] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:45.519019 542 sys_catalog.cc:455] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader e663d9e9d88f49fbbbfef7234b15d7ab. Latest consensus state: current_term: 1 leader_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } } }
I20260812 09:54:45.519176 542 sys_catalog.cc:458] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:45.519439 541 sys_catalog.cc:455] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e663d9e9d88f49fbbbfef7234b15d7ab" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 34241 } } }
I20260812 09:54:45.519531 541 sys_catalog.cc:458] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab [sys.catalog]: This master's current role is: LEADER
W20260812 09:54:45.522883 558 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:54:45.523012 558 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:54:45.523113 550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:45.523887 550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:45.529568 550 catalog_manager.cc:1347] Generated new cluster ID: 201220096fe0406c8381dbc92f1d288c
I20260812 09:54:45.529657 550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:45.549045 550 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:45.550402 550 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:45.557278 550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: Generated new TSK 0
I20260812 09:54:45.558173 550 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:45.566108 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--builtin_ntp_servers=127.11.118.148:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:45.689078 562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:45.689430 562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:45.689517 562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:45.694236 562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:45.694342 562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:45.694437 562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:45.699666 562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:45.700932 562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:45.702405 562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:45.712963 569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:45.712986 567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:45.712963 573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:45.713236 562 server_base.cc:1034] running on GCE node
I20260812 09:54:45.713901 562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:45.714641 562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:45.715843 562 hybrid_clock.cc:648] HybridClock initialized: now 1786528485715816 us; error 39 us; skew 500 ppm
I20260812 09:54:45.718196 562 webserver.cc:460] Webserver started at http://127.11.118.129:40193/ using document root <none> and password file <none>
I20260812 09:54:45.718864 562 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:45.718935 562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:45.719221 562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:45.721503 562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "0a0f6f06b82a4d91b99702f002573f24"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "22a449d53df4fc5fa8404c142cc11b98"
server_key_iv: "4f7193a2320371fa8601c88ceceaceb4"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.722128 562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "0a0f6f06b82a4d91b99702f002573f24"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "22a449d53df4fc5fa8404c142cc11b98"
server_key_iv: "4f7193a2320371fa8601c88ceceaceb4"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.726311 562 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:54:45.729256 581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.730911 562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:54:45.731179 562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "0a0f6f06b82a4d91b99702f002573f24"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "22a449d53df4fc5fa8404c142cc11b98"
server_key_iv: "4f7193a2320371fa8601c88ceceaceb4"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.731338 562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:45.757740 562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:45.758526 562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:45.758755 562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:45.759473 562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:45.760505 562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:45.760574 562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.760645 562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:45.760689 562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.770287 562 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:37837
I20260812 09:54:45.770313 713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:37837 every 8 connection(s)
I20260812 09:54:45.771437 562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:45.775096 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 562
I20260812 09:54:45.775238 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:45.775548 11738 external_mini_cluster.cc:1428] Setting key 088e63ff17ded675826a663e06eb31b2
I20260812 09:54:45.777916 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--builtin_ntp_servers=127.11.118.148:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:45.781795 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.773405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:37631 (local address 127.11.118.190:34241)
0812 09:54:45.773602 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.773607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.774736 (+ 1129us) server_negotiation.cc:407] Connection header received
0812 09:54:45.776429 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.776433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.776479 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.776574 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:45.777619 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.778448 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.779717 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.779946 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.780062 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.781288 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:45.781297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:45.781300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:45.781313 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:45.781334 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:45.781344 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:45.781427 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.781586 (+ 159us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.781649 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 09:54:45.782780 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.773845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34241 (local address 127.11.118.129:37631)
0812 09:54:45.774556 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.774599 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.776251 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.776719 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.776725 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.776809 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:45.777446 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.777460 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.778586 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.778589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.779580 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.779589 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.780113 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.780118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.780281 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.781020 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:45.781022 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:45.781062 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:45.781128 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:45.781430 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:45.781443 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:45.781451 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.781587 (+ 136us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.781883 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":132,"threads_started":1}
I20260812 09:54:45.784164 714 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34241
I20260812 09:54:45.784473 714 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:45.785211 714 heartbeater.cc:511] Master 127.11.118.190:34241 requested a full tablet report, sending...
I20260812 09:54:45.787279 494 ts_manager.cc:194] Registered new tserver with Master: 0a0f6f06b82a4d91b99702f002573f24 (127.11.118.129:37837)
I20260812 09:54:45.789113 494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.129:37631
W20260812 09:54:45.904215 721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:45.904624 721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:45.904675 721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:45.909049 721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:45.909134 721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:45.909211 721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:45.914300 721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:45.915536 721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:45.916936 721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:45.927906 726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:45.927925 727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:45.927937 730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:45.928296 721 server_base.cc:1034] running on GCE node
I20260812 09:54:45.928714 721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:45.929450 721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:45.930629 721 hybrid_clock.cc:648] HybridClock initialized: now 1786528485930565 us; error 76 us; skew 500 ppm
I20260812 09:54:45.932768 721 webserver.cc:460] Webserver started at http://127.11.118.130:33133/ using document root <none> and password file <none>
I20260812 09:54:45.933360 721 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:45.933429 721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:45.933604 721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:45.936044 721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "b7c28491dfdc47d5895af51ad4fd9304"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "73cc96797ac9331cf5bf6f994dd1b435"
server_key_iv: "7742af6b0eab5595eb8014cb817b9e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.936626 721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "b7c28491dfdc47d5895af51ad4fd9304"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "73cc96797ac9331cf5bf6f994dd1b435"
server_key_iv: "7742af6b0eab5595eb8014cb817b9e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.940676 721 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:45.943378 736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.944850 721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:54:45.945060 721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "b7c28491dfdc47d5895af51ad4fd9304"
format_stamp: "Formatted at 2026-08-12 09:54:45 on dist-test-slave-2w3w"
server_key: "73cc96797ac9331cf5bf6f994dd1b435"
server_key_iv: "7742af6b0eab5595eb8014cb817b9e72"
server_key_version: "encryptionkey@0"
I20260812 09:54:45.945204 721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:45.963048 721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:45.963914 721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:45.964154 721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:45.964890 721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:45.966001 721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:45.966086 721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.966168 721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:45.966228 721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:45.977007 721 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:45569
I20260812 09:54:45.977037 868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:45569 every 8 connection(s)
I20260812 09:54:45.978075 721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:45.986794 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 721
I20260812 09:54:45.987066 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:45.987419 11738 external_mini_cluster.cc:1428] Setting key 59e6bc5350e31936df9545b367fb9e1f
I20260812 09:54:45.988481 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.980265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:52961 (local address 127.11.118.190:34241)
0812 09:54:45.980443 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:45.980447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:45.981589 (+ 1142us) server_negotiation.cc:407] Connection header received
0812 09:54:45.983151 (+ 1562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:45.983155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:45.983213 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:45.983335 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:45.984349 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.984910 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.986147 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.986365 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.986487 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.987945 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:45.987948 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:45.987951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:45.987963 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:45.987986 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:45.987994 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:45.988077 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:45.988260 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 09:54:45.988334 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 09:54:45.989738 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:45.980637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34241 (local address 127.11.118.130:52961)
0812 09:54:45.981408 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:45.981462 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:45.982814 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:45.983505 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:45.983512 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:45.983604 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:45.984149 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.984182 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.985054 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.985057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.986013 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:45.986023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:45.986611 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:45.986616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:45.986825 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:45.987581 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:45.987584 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:45.987641 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:45.987730 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:45.988092 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:45.988104 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:45.988116 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 09:54:45.988259 (+ 143us) client_negotiation.cc:240] Negotiation successful
0812 09:54:45.988615 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":141,"threads_started":1}
I20260812 09:54:45.990000 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--builtin_ntp_servers=127.11.118.148:38697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:45.991482 869 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34241
I20260812 09:54:45.991850 869 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:45.992578 869 heartbeater.cc:511] Master 127.11.118.190:34241 requested a full tablet report, sending...
I20260812 09:54:45.993956 494 ts_manager.cc:194] Registered new tserver with Master: b7c28491dfdc47d5895af51ad4fd9304 (127.11.118.130:45569)
I20260812 09:54:45.994836 494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.130:52961
W20260812 09:54:46.113234 872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:46.113539 872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:46.113580 872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:46.117872 872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:46.117954 872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:46.118013 872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:46.123467 872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:34241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:46.124661 872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:46.126037 872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:46.136909 881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:46.136938 879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:46.137034 872 server_base.cc:1034] running on GCE node
W20260812 09:54:46.136909 878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:46.137677 872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:46.138543 872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:46.139778 872 hybrid_clock.cc:648] HybridClock initialized: now 1786528486139735 us; error 62 us; skew 500 ppm
I20260812 09:54:46.141829 872 webserver.cc:460] Webserver started at http://127.11.118.131:43459/ using document root <none> and password file <none>
I20260812 09:54:46.142403 872 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:46.142468 872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:46.142640 872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:46.144943 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "dab02a53aa244cf69e2cc9afe07292ee"
format_stamp: "Formatted at 2026-08-12 09:54:46 on dist-test-slave-2w3w"
server_key: "1eced7cfa2ff8b672d53468c960b9c8f"
server_key_iv: "0a8cf4302fac9b4a9b3f4901d89fc910"
server_key_version: "encryptionkey@0"
I20260812 09:54:46.145485 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "dab02a53aa244cf69e2cc9afe07292ee"
format_stamp: "Formatted at 2026-08-12 09:54:46 on dist-test-slave-2w3w"
server_key: "1eced7cfa2ff8b672d53468c960b9c8f"
server_key_iv: "0a8cf4302fac9b4a9b3f4901d89fc910"
server_key_version: "encryptionkey@0"
I20260812 09:54:46.149541 872 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 09:54:46.152311 887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:46.153717 872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:54:46.153944 872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "dab02a53aa244cf69e2cc9afe07292ee"
format_stamp: "Formatted at 2026-08-12 09:54:46 on dist-test-slave-2w3w"
server_key: "1eced7cfa2ff8b672d53468c960b9c8f"
server_key_iv: "0a8cf4302fac9b4a9b3f4901d89fc910"
server_key_version: "encryptionkey@0"
I20260812 09:54:46.154083 872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:46.172818 872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:46.173610 872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:46.173836 872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:46.174497 872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:46.175609 872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:46.175684 872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:46.175771 872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:46.175823 872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:46.185735 872 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:42479
I20260812 09:54:46.185777 1024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:42479 every 8 connection(s)
I20260812 09:54:46.186719 872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:46.189767 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 872
I20260812 09:54:46.189901 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:46.190203 11738 external_mini_cluster.cc:1428] Setting key 34e4fde588d5a14d07796ca6bc21b6a5
I20260812 09:54:46.198176 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.189048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:37903 (local address 127.11.118.190:34241)
0812 09:54:46.189191 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.189203 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.190553 (+ 1350us) server_negotiation.cc:407] Connection header received
0812 09:54:46.192351 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.192354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.192415 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.192511 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:46.193618 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.194186 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.195937 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.196173 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.196263 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.197597 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:46.197601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:46.197603 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:46.197619 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:46.197651 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:46.197660 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:46.197731 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.197962 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.198046 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 09:54:46.199190 1028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.189436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:34241 (local address 127.11.118.131:37903)
0812 09:54:46.190355 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.190417 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.192089 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.192732 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.192743 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.192867 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:46.193466 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.193481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.194378 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.194382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.195767 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.195778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.196366 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.196370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.196551 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.197278 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:46.197279 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:46.197325 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:46.197401 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:46.197780 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:46.197791 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:46.197797 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.197930 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.198193 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":172,"threads_started":1}
I20260812 09:54:46.200722 1025 heartbeater.cc:347] Connected to a master server at 127.11.118.190:34241
I20260812 09:54:46.201073 1025 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:46.201689 1025 heartbeater.cc:511] Master 127.11.118.190:34241 requested a full tablet report, sending...
I20260812 09:54:46.202878 494 ts_manager.cc:194] Registered new tserver with Master: dab02a53aa244cf69e2cc9afe07292ee (127.11.118.131:42479)
I20260812 09:54:46.203728 494 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.131:37903
I20260812 09:54:46.205103 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:46.211640 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.207158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50950 (local address 127.11.118.190:34241)
0812 09:54:46.207265 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.207269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.207532 (+ 263us) server_negotiation.cc:407] Connection header received
0812 09:54:46.207638 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.207640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.207678 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.207747 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:46.208077 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.208596 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.209509 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.209729 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.209818 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.211078 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:46.211081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:46.211083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:46.211098 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:46.211120 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:46.211129 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:46.211252 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.211455 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.211514 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 09:54:46.215442 494 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:46.218770 494 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:46.235038 1045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.229869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48810 (local address 127.11.118.131:42479)
0812 09:54:46.230327 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.230342 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.230578 (+ 236us) server_negotiation.cc:407] Connection header received
0812 09:54:46.230718 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.230722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.230863 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.231042 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:46.231248 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232080 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.233658 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.234233 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.234382 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.234585 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.234693 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.234871 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":154,"threads_started":1}
I20260812 09:54:46.235029 1039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.229430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:42479 (local address 127.0.0.1:48810)
0812 09:54:46.230476 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.230487 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.230602 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.231020 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.231023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.231041 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:46.231150 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.231160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232198 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.232203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.233528 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.233538 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.234370 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.234374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.234490 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.234538 (+ 48us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.234663 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.234821 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"mutex_wait_us":2,"thread_start_us":99,"threads_started":1}
I20260812 09:54:46.235519 1042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.228883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:45569 (local address 127.0.0.1:33960)
0812 09:54:46.229959 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.229974 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.230059 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.231323 (+ 1264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.231326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.231345 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:46.231417 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.231423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232770 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.232774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.233864 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.233874 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.235094 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.235101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.235196 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.235227 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.235289 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.235359 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"mutex_wait_us":17,"thread_start_us":103,"threads_started":1}
I20260812 09:54:46.236083 1041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.228688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37837 (local address 127.0.0.1:51428)
0812 09:54:46.229670 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.229723 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.229872 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.230526 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.230532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.230555 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:46.230707 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.230715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232229 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.232233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.234051 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.234057 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.235263 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.235270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.235355 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.235374 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.235430 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.235504 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":107,"spinlock_wait_cycles":5376,"thread_start_us":87,"threads_started":1}
I20260812 09:54:46.236228 1040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.228830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51428 (local address 127.11.118.129:37837)
0812 09:54:46.229206 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.229213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.230037 (+ 824us) server_negotiation.cc:407] Connection header received
0812 09:54:46.230129 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.230134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.230371 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.230535 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:46.230865 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232087 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.234175 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.235050 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.235591 (+ 541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.235893 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.235948 (+ 55us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.236045 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":154,"threads_started":1}
I20260812 09:54:46.236864 1044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.229416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33960 (local address 127.11.118.130:45569)
0812 09:54:46.230866 (+ 1450us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.230879 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.230901 (+ 22us) server_negotiation.cc:407] Connection header received
0812 09:54:46.231000 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.231004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.231171 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.231331 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:46.231541 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.232631 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.233992 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.234909 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.236487 (+ 1578us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.236625 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.236665 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.236742 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1335,"thread_start_us":133,"threads_started":1}
I20260812 09:54:46.238477 946 tablet_service.cc:1467] Processing CreateTablet for tablet d82c2efb6234455aabb6c50335a4211d (DEFAULT_TABLE table=test-table [id=713b1ad18db84ac3ba5b63e82da51f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:46.238741 636 tablet_service.cc:1467] Processing CreateTablet for tablet d82c2efb6234455aabb6c50335a4211d (DEFAULT_TABLE table=test-table [id=713b1ad18db84ac3ba5b63e82da51f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:46.239770 946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82c2efb6234455aabb6c50335a4211d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:46.239866 636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82c2efb6234455aabb6c50335a4211d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:46.239662 794 tablet_service.cc:1467] Processing CreateTablet for tablet d82c2efb6234455aabb6c50335a4211d (DEFAULT_TABLE table=test-table [id=713b1ad18db84ac3ba5b63e82da51f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:46.240672 794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82c2efb6234455aabb6c50335a4211d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:46.246826 1047 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Bootstrap starting.
I20260812 09:54:46.247560 1048 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Bootstrap starting.
I20260812 09:54:46.249766 1049 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Bootstrap starting.
I20260812 09:54:46.250058 1047 tablet_bootstrap.cc:654] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:46.250047 1048 tablet_bootstrap.cc:654] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:46.251067 1048 log.cc:824] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:46.251067 1047 log.cc:824] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:46.252151 1049 tablet_bootstrap.cc:654] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:46.252965 1049 log.cc:824] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:46.253271 1047 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: No bootstrap required, opened a new log
I20260812 09:54:46.253507 1047 ts_tablet_manager.cc:1397] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260812 09:54:46.254839 1048 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: No bootstrap required, opened a new log
I20260812 09:54:46.254940 1049 tablet_bootstrap.cc:492] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: No bootstrap required, opened a new log
I20260812 09:54:46.255090 1048 ts_tablet_manager.cc:1397] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 09:54:46.255158 1049 ts_tablet_manager.cc:1397] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260812 09:54:46.258440 1047 raft_consensus.cc:348] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.258802 1047 raft_consensus.cc:374] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:46.258869 1047 raft_consensus.cc:729] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0f6f06b82a4d91b99702f002573f24, State: Initialized, Role: FOLLOWER
I20260812 09:54:46.258952 1049 raft_consensus.cc:348] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.259254 1049 raft_consensus.cc:374] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:46.259323 1049 raft_consensus.cc:729] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c28491dfdc47d5895af51ad4fd9304, State: Initialized, Role: FOLLOWER
I20260812 09:54:46.259599 1047 consensus_queue.cc:260] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.259584 1048 raft_consensus.cc:348] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.259778 1049 consensus_queue.cc:260] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.259907 1048 raft_consensus.cc:374] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:46.259981 1048 raft_consensus.cc:729] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dab02a53aa244cf69e2cc9afe07292ee, State: Initialized, Role: FOLLOWER
I20260812 09:54:46.260439 1048 consensus_queue.cc:260] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.260824 1047 ts_tablet_manager.cc:1428] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 09:54:46.260828 1049 ts_tablet_manager.cc:1428] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260812 09:54:46.261224 869 heartbeater.cc:503] Master 127.11.118.190:34241 was elected leader, sending a full tablet report...
I20260812 09:54:46.261392 1048 ts_tablet_manager.cc:1428] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:54:46.261711 1025 heartbeater.cc:503] Master 127.11.118.190:34241 was elected leader, sending a full tablet report...
I20260812 09:54:46.262290 714 heartbeater.cc:503] Master 127.11.118.190:34241 was elected leader, sending a full tablet report...
W20260812 09:54:46.272691 717 tablet.cc:2369] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:54:46.357419 1055 raft_consensus.cc:482] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:46.357745 1055 raft_consensus.cc:504] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.359078 1055 leader_election.cc:288] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0f6f06b82a4d91b99702f002573f24 (127.11.118.129:37837), dab02a53aa244cf69e2cc9afe07292ee (127.11.118.131:42479)
I20260812 09:54:46.363662 1045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.359491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:58013 (local address 127.11.118.131:42479)
0812 09:54:46.359633 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.359638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.359702 (+ 64us) server_negotiation.cc:407] Connection header received
0812 09:54:46.359954 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.359957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.360006 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.360094 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:46.360390 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.361048 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.362582 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.363056 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.363200 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.363253 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.363451 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.363529 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 09:54:46.363662 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.359379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:42479 (local address 127.11.118.130:58013)
0812 09:54:46.359613 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.359629 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.359815 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.360107 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.360109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.360127 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:46.360265 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.360275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.361180 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.361184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.362436 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.362446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.363198 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.363202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.363308 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.363329 (+ 21us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.363432 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.363519 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":87}
I20260812 09:54:46.364238 1040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.359506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:49745 (local address 127.11.118.129:37837)
0812 09:54:46.359633 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.359638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.360025 (+ 387us) server_negotiation.cc:407] Connection header received
0812 09:54:46.360186 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.360188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.360243 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.360345 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:46.360623 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.361268 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.363106 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.363591 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.363764 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.363831 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.364039 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.364121 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 09:54:46.364249 1057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.359379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37837 (local address 127.11.118.130:49745)
0812 09:54:46.359893 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.359907 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:46.360058 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:46.360351 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:46.360354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:46.360371 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:46.360498 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.360504 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.361394 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.361398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.362435 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:46.362446 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.363764 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.363768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:46.363890 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.363909 (+ 19us) client_negotiation.cc:769] Sending connection context
0812 09:54:46.364002 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 09:54:46.364083 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":83,"thread_start_us":126,"threads_started":1}
I20260812 09:54:46.364708 973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82c2efb6234455aabb6c50335a4211d" candidate_uuid: "b7c28491dfdc47d5895af51ad4fd9304" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dab02a53aa244cf69e2cc9afe07292ee" is_pre_election: true
I20260812 09:54:46.364856 662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82c2efb6234455aabb6c50335a4211d" candidate_uuid: "b7c28491dfdc47d5895af51ad4fd9304" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0f6f06b82a4d91b99702f002573f24" is_pre_election: true
I20260812 09:54:46.365082 973 raft_consensus.cc:2454] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c28491dfdc47d5895af51ad4fd9304 in term 0.
I20260812 09:54:46.365232 662 raft_consensus.cc:2454] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c28491dfdc47d5895af51ad4fd9304 in term 0.
I20260812 09:54:46.365669 739 leader_election.cc:302] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7c28491dfdc47d5895af51ad4fd9304, dab02a53aa244cf69e2cc9afe07292ee; no voters:
I20260812 09:54:46.365998 1055 raft_consensus.cc:2781] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:46.366093 1055 raft_consensus.cc:482] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:46.366138 1055 raft_consensus.cc:3037] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:46.367331 1055 raft_consensus.cc:504] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.367717 1055 leader_election.cc:288] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0f6f06b82a4d91b99702f002573f24 (127.11.118.129:37837), dab02a53aa244cf69e2cc9afe07292ee (127.11.118.131:42479)
I20260812 09:54:46.368141 973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82c2efb6234455aabb6c50335a4211d" candidate_uuid: "b7c28491dfdc47d5895af51ad4fd9304" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dab02a53aa244cf69e2cc9afe07292ee"
I20260812 09:54:46.368192 662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82c2efb6234455aabb6c50335a4211d" candidate_uuid: "b7c28491dfdc47d5895af51ad4fd9304" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0f6f06b82a4d91b99702f002573f24"
I20260812 09:54:46.368294 973 raft_consensus.cc:3037] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:46.368383 662 raft_consensus.cc:3037] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:46.369553 662 raft_consensus.cc:2454] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c28491dfdc47d5895af51ad4fd9304 in term 1.
I20260812 09:54:46.369563 973 raft_consensus.cc:2454] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c28491dfdc47d5895af51ad4fd9304 in term 1.
I20260812 09:54:46.369961 742 leader_election.cc:302] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0f6f06b82a4d91b99702f002573f24, b7c28491dfdc47d5895af51ad4fd9304; no voters:
I20260812 09:54:46.370224 1055 raft_consensus.cc:2781] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:46.370581 1055 raft_consensus.cc:686] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 1 LEADER]: Becoming Leader. State: Replica: b7c28491dfdc47d5895af51ad4fd9304, State: Running, Role: LEADER
I20260812 09:54:46.371300 1055 consensus_queue.cc:237] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } }
I20260812 09:54:46.375130 493 catalog_manager.cc:5495] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c28491dfdc47d5895af51ad4fd9304 (127.11.118.130). New cstate: current_term: 1 leader_uuid: "b7c28491dfdc47d5895af51ad4fd9304" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7c28491dfdc47d5895af51ad4fd9304" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 45569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 } health_report { overall_health: UNKNOWN } } }
I20260812 09:54:46.402169 1044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.397919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33974 (local address 127.11.118.130:45569)
0812 09:54:46.398180 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:46.398184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:46.398203 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:54:46.398290 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:46.398293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:46.398353 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:46.398646 (+ 293us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:46.399002 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.399518 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.400483 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:46.400707 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:46.400874 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:46.401194 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:46.401630 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:46.401757 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:46.401924 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 09:54:46.402004 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 09:54:46.409339 662 raft_consensus.cc:1261] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 1 FOLLOWER]: Refusing update from remote peer b7c28491dfdc47d5895af51ad4fd9304: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:46.409351 973 raft_consensus.cc:1261] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 1 FOLLOWER]: Refusing update from remote peer b7c28491dfdc47d5895af51ad4fd9304: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:46.410488 1058 consensus_queue.cc:1035] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dab02a53aa244cf69e2cc9afe07292ee" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 42479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:46.410729 1055 consensus_queue.cc:1035] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0f6f06b82a4d91b99702f002573f24" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:46.421401 1062 mvcc.cc:205] Tried to move back new op lower bound from 7317620680322240512 to 7317620680179621888. Current Snapshot: MvccSnapshot[applied={T|T < 7317620680322240512}]
I20260812 09:54:46.424214 1063 mvcc.cc:205] Tried to move back new op lower bound from 7317620680322240512 to 7317620680179621888. Current Snapshot: MvccSnapshot[applied={T|T < 7317620680322240512 or (T in {7317620680322240512})}]
I20260812 09:54:46.431208 492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:46.431422 492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:46.434324 492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e663d9e9d88f49fbbbfef7234b15d7ab: Sending DeleteTablet for 3 replicas of tablet d82c2efb6234455aabb6c50335a4211d
I20260812 09:54:46.435664 636 tablet_service.cc:1514] Processing DeleteTablet for tablet d82c2efb6234455aabb6c50335a4211d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:46 UTC) from {username='slave'} at 127.0.0.1:51428
I20260812 09:54:46.435796 794 tablet_service.cc:1514] Processing DeleteTablet for tablet d82c2efb6234455aabb6c50335a4211d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:46 UTC) from {username='slave'} at 127.0.0.1:33960
I20260812 09:54:46.436064 946 tablet_service.cc:1514] Processing DeleteTablet for tablet d82c2efb6234455aabb6c50335a4211d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:46 UTC) from {username='slave'} at 127.0.0.1:48810
I20260812 09:54:46.436623 1076 tablet_replica.cc:330] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: stopping tablet replica
I20260812 09:54:46.436741 1074 tablet_replica.cc:330] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24: stopping tablet replica
I20260812 09:54:46.437031 1076 raft_consensus.cc:2229] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:46.437077 1074 raft_consensus.cc:2229] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:46.437441 1075 tablet_replica.cc:330] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: stopping tablet replica
I20260812 09:54:46.437464 1074 raft_consensus.cc:2258] T d82c2efb6234455aabb6c50335a4211d P 0a0f6f06b82a4d91b99702f002573f24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:46.437733 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 562
I20260812 09:54:46.437922 1075 raft_consensus.cc:2229] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:54:46.438489 1075 raft_consensus.cc:2258] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:46.443809 1076 raft_consensus.cc:2258] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:46.445712 1075 ts_tablet_manager.cc:1905] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:46.450439 1075 ts_tablet_manager.cc:1918] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:46.450733 1075 log.cc:1196] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/d82c2efb6234455aabb6c50335a4211d
I20260812 09:54:46.451020 1076 ts_tablet_manager.cc:1905] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:46.451411 1075 ts_tablet_manager.cc:1939] T d82c2efb6234455aabb6c50335a4211d P b7c28491dfdc47d5895af51ad4fd9304: Deleting consensus metadata
W20260812 09:54:46.452582 476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:37837 (error 108)
I20260812 09:54:46.453109 474 catalog_manager.cc:4841] TS b7c28491dfdc47d5895af51ad4fd9304 (127.11.118.130:45569): tablet d82c2efb6234455aabb6c50335a4211d (table test-table [id=713b1ad18db84ac3ba5b63e82da51f22]) successfully deleted
I20260812 09:54:46.454433 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 721
I20260812 09:54:46.454949 1041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:46.454391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:37837 (local address 127.0.0.1:51442)
0812 09:54:46.454632 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:46.454745 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:37837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260812 09:54:46.459113 1076 ts_tablet_manager.cc:1918] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:46.459291 1076 log.cc:1196] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/d82c2efb6234455aabb6c50335a4211d
I20260812 09:54:46.459672 1076 ts_tablet_manager.cc:1939] T d82c2efb6234455aabb6c50335a4211d P dab02a53aa244cf69e2cc9afe07292ee: Deleting consensus metadata
W20260812 09:54:46.460774 476 catalog_manager.cc:4584] TS 0a0f6f06b82a4d91b99702f002573f24 (127.11.118.129:37837): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d82c2efb6234455aabb6c50335a4211d: Network error: Client connection negotiation failed: client connection to 127.11.118.129:37837: connect: Connection refused (error 111)
I20260812 09:54:46.461324 474 catalog_manager.cc:4841] TS dab02a53aa244cf69e2cc9afe07292ee (127.11.118.131:42479): tablet d82c2efb6234455aabb6c50335a4211d (table test-table [id=713b1ad18db84ac3ba5b63e82da51f22]) successfully deleted
I20260812 09:54:46.467240 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 872
I20260812 09:54:46.480142 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 456
2026-08-12T09:54:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1234 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:46 dist-test-slave-2w3w krb5kdc[1081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:46 dist-test-slave-2w3w krb5kdc[1081](info): set up 2 sockets
Aug 12 09:54:46 dist-test-slave-2w3w krb5kdc[1081](info): commencing operation
krb5kdc: starting...
W20260812 09:54:47.719475 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:47 dist-test-slave-2w3w krb5kdc[1081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:54:47.878535 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:43483
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:43483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:48.007808 1104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:48.008142 1104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:48.008186 1104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:48.012486 1104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:48.012575 1104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:48.012598 1104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:48.012615 1104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:48.012631 1104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:48.018484 1104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:43483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:43483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:48.019677 1104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:48.020691 1104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:48.031008 1111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.031013 1113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.031013 1110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:48.031462 1104 server_base.cc:1034] running on GCE node
I20260812 09:54:48.032312 1104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:48.033605 1104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:48.034842 1104 hybrid_clock.cc:648] HybridClock initialized: now 1786528488034848 us; error 69 us; skew 500 ppm
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:48.038574 1104 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:54:48.039830 1104 webserver.cc:460] Webserver started at http://127.11.118.190:41895/ using document root <none> and password file <none>
I20260812 09:54:48.040512 1104 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:48.040625 1104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:48.041057 1104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:48.043735 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "23210a3d731143bc96837ac5fe37eb4e"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "8f589108a8f949b1888ea6afa4274aaf"
server_key_iv: "6f455c1679ad3bbb12d21bebc3e3be82"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.044513 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "23210a3d731143bc96837ac5fe37eb4e"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "8f589108a8f949b1888ea6afa4274aaf"
server_key_iv: "6f455c1679ad3bbb12d21bebc3e3be82"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.049337 1104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:48.052489 1125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.054163 1104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:54:48.054370 1104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "23210a3d731143bc96837ac5fe37eb4e"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "8f589108a8f949b1888ea6afa4274aaf"
server_key_iv: "6f455c1679ad3bbb12d21bebc3e3be82"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.054535 1104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:48.075629 1104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:48.079856 1104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:48.080120 1104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:48.089195 1104 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:43483
I20260812 09:54:48.089440 1185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:43483 every 8 connection(s)
I20260812 09:54:48.090355 1104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:48.093595 1186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:48.098176 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1104
I20260812 09:54:48.098307 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:48.098726 11738 external_mini_cluster.cc:1428] Setting key a572bb2282d3639ba2a48c858e0d6085
I20260812 09:54:48.100787 1186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: Bootstrap starting.
I20260812 09:54:48.104518 1186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:48.105561 1186 log.cc:824] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:48.108497 1186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: No bootstrap required, opened a new log
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:48.113482 1186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } }
I20260812 09:54:48.113834 1186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:48.113891 1186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23210a3d731143bc96837ac5fe37eb4e, State: Initialized, Role: FOLLOWER
I20260812 09:54:48.114535 1186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } }
I20260812 09:54:48.114769 1186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:48.114981 1186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:48.115141 1186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:48.116631 1186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } }
I20260812 09:54:48.117089 1186 leader_election.cc:302] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23210a3d731143bc96837ac5fe37eb4e; no voters:
I20260812 09:54:48.117509 1186 leader_election.cc:288] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:48.117657 1192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:48.117913 1192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [term 1 LEADER]: Becoming Leader. State: Replica: 23210a3d731143bc96837ac5fe37eb4e, State: Running, Role: LEADER
I20260812 09:54:48.118269 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.100554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.11.118.190:43483)
0812 09:54:48.101165 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:48.101195 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:48.101251 (+ 56us) server_negotiation.cc:407] Connection header received
0812 09:54:48.102301 (+ 1050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:48.102333 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:48.102878 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:48.103483 (+ 605us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:48.104344 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.105976 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.107354 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.108076 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.108280 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.111485 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:48.111494 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:48.111523 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:48.111576 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:48.113957 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.114612 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.114620 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.114627 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.114832 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.115267 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.115271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.115273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.115897 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:48.116148 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:48.116530 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 09:54:48.116918 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":167,"threads_started":1}
I20260812 09:54:48.118381 1192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } }
I20260812 09:54:48.119445 1186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:48.121603 1193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23210a3d731143bc96837ac5fe37eb4e. Latest consensus state: current_term: 1 leader_uuid: "23210a3d731143bc96837ac5fe37eb4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } } }
I20260812 09:54:48.121763 1193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:48.122051 1194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23210a3d731143bc96837ac5fe37eb4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23210a3d731143bc96837ac5fe37eb4e" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 43483 } } }
I20260812 09:54:48.122177 1194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:48.122188 1201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:48.125823 1201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:48.133394 1201 catalog_manager.cc:1347] Generated new cluster ID: 86f537b31930489fae3f77c45bd5c08e
I20260812 09:54:48.133509 1201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:48.141155 1201 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:48.142254 1201 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:48.155015 1201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: Generated new TSK 0
I20260812 09:54:48.155882 1201 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.118.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
Entry for principal kudu/127.11.118.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab.
I20260812 09:54:48.210474 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:48.368265 1216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:48.368589 1216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:48.368637 1216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:48.372826 1216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:48.372913 1216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:48.372977 1216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:48.378729 1216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.129.keytab
--principal=kudu/127.11.118.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:48.380100 1216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:48.381258 1216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:48.392371 1224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.392481 1222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.392371 1221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:48.392994 1216 server_base.cc:1034] running on GCE node
I20260812 09:54:48.393545 1216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:48.394392 1216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:48.395623 1216 hybrid_clock.cc:648] HybridClock initialized: now 1786528488395603 us; error 37 us; skew 500 ppm
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:48.399163 1216 init.cc:377] Logged in from keytab as kudu/127.11.118.129@KRBTEST.COM (short username kudu)
I20260812 09:54:48.400275 1216 webserver.cc:460] Webserver started at http://127.11.118.129:46627/ using document root <none> and password file <none>
I20260812 09:54:48.400894 1216 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:48.400995 1216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:48.401244 1216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:48.403573 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "9bedfbcadbd64911a3791a7c32103899"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "f83ad6238c799a3afb60f0028eaafdfd"
server_key_iv: "b329e58085d532f93a28043b56820336"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.404285 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "9bedfbcadbd64911a3791a7c32103899"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "f83ad6238c799a3afb60f0028eaafdfd"
server_key_iv: "b329e58085d532f93a28043b56820336"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.408814 1216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:48.412195 1233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.413730 1216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:54:48.413908 1216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "9bedfbcadbd64911a3791a7c32103899"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "f83ad6238c799a3afb60f0028eaafdfd"
server_key_iv: "b329e58085d532f93a28043b56820336"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.414060 1216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:48.430311 1216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:48.434414 1216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:48.434660 1216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:48.435436 1216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:48.436352 1216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:48.436424 1216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.436501 1216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:48.436544 1216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.446641 1216 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:46399
I20260812 09:54:48.446705 1367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:46399 every 8 connection(s)
I20260812 09:54:48.447777 1216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:48.451416 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1216
I20260812 09:54:48.451575 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:48.451920 11738 external_mini_cluster.cc:1428] Setting key d210fc09a653b010d14ada28a480d7d7
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.129@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.130@KRBTEST.COM; defaulting to no policy
I20260812 09:54:48.464126 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.449925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:44377 (local address 127.11.118.190:43483)
0812 09:54:48.450130 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:48.450136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:48.451797 (+ 1661us) server_negotiation.cc:407] Connection header received
0812 09:54:48.452918 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:48.452921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:48.452968 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:48.453057 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:48.454378 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.455366 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.456719 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.456978 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.457106 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.460151 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:48.460155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:48.460160 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:48.460193 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:48.461760 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.462379 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.462383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.462385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.462466 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.462845 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.462849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.462851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.463131 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:48.463246 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:48.463808 (+ 562us) server_negotiation.cc:299] Negotiation successful
0812 09:54:48.463951 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 09:54:48.465013 1370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.450348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:43483 (local address 127.11.118.129:44377)
0812 09:54:48.451582 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:48.451658 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:48.452698 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:48.453212 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:48.453220 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:48.453632 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:48.454199 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.454216 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.455536 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.455539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.456551 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.456563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.457174 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.457178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.457400 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.458104 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:48.458122 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:48.459941 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:48.461916 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.461923 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.461941 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.462244 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.462564 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.462567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.462570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.462738 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.463248 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:48.463259 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:48.463550 (+ 291us) client_negotiation.cc:769] Sending connection context
0812 09:54:48.463757 (+ 207us) client_negotiation.cc:240] Negotiation successful
0812 09:54:48.464127 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":700,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.130@KRBTEST.COM" created.
I20260812 09:54:48.466706 1368 heartbeater.cc:347] Connected to a master server at 127.11.118.190:43483
I20260812 09:54:48.467020 1368 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:48.467592 1368 heartbeater.cc:511] Master 127.11.118.190:43483 requested a full tablet report, sending...
I20260812 09:54:48.469516 1145 ts_manager.cc:194] Registered new tserver with Master: 9bedfbcadbd64911a3791a7c32103899 (127.11.118.129:46399)
I20260812 09:54:48.470713 1145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.129@KRBTEST.COM'} at 127.11.118.129:44377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
Entry for principal kudu/127.11.118.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab.
I20260812 09:54:48.487187 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:48.611052 1373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:48.611375 1373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:48.611421 1373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:48.615754 1373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:48.615837 1373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:48.615911 1373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:48.622539 1373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.130.keytab
--principal=kudu/127.11.118.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:48.623816 1373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:48.624933 1373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:54:48.636545 1373 server_base.cc:1034] running on GCE node
W20260812 09:54:48.636468 1380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.636487 1382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.636468 1378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:48.637224 1373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:48.638008 1373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:48.639249 1373 hybrid_clock.cc:648] HybridClock initialized: now 1786528488639207 us; error 58 us; skew 500 ppm
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:48.642685 1373 init.cc:377] Logged in from keytab as kudu/127.11.118.130@KRBTEST.COM (short username kudu)
I20260812 09:54:48.643956 1373 webserver.cc:460] Webserver started at http://127.11.118.130:39837/ using document root <none> and password file <none>
I20260812 09:54:48.644634 1373 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:48.644750 1373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:48.645097 1373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:48.647689 1373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "2c942216e2d9434cb8bdc2a13371286a"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "91cc90c564fa8b7dd8875d51c8a053a5"
server_key_iv: "cee5b51d70676234997455f5db2cf80d"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.648419 1373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "2c942216e2d9434cb8bdc2a13371286a"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "91cc90c564fa8b7dd8875d51c8a053a5"
server_key_iv: "cee5b51d70676234997455f5db2cf80d"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.653401 1373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 09:54:48.657136 1389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.658718 1373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:54:48.658999 1373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "2c942216e2d9434cb8bdc2a13371286a"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "91cc90c564fa8b7dd8875d51c8a053a5"
server_key_iv: "cee5b51d70676234997455f5db2cf80d"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.659169 1373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:48.691962 1373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:48.695900 1373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:48.696105 1373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:48.696800 1373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:48.697736 1373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:48.697786 1373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.697832 1373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:48.697849 1373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.709972 1373 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:34049
I20260812 09:54:48.710021 1530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:34049 every 8 connection(s)
I20260812 09:54:48.711107 1373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:48.717010 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1373
I20260812 09:54:48.717346 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:48.717706 11738 external_mini_cluster.cc:1428] Setting key bbe6baef4ed0a157f2ad777be28a798f
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.130@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.131@KRBTEST.COM; defaulting to no policy
I20260812 09:54:48.730188 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.713624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:40617 (local address 127.11.118.190:43483)
0812 09:54:48.713799 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:48.713804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:48.715509 (+ 1705us) server_negotiation.cc:407] Connection header received
0812 09:54:48.716508 (+ 999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:48.716512 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:48.716570 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:48.716661 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:48.718754 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.719481 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.721676 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.721928 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.722029 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.725631 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:48.725635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:48.725638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:48.725670 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:48.727633 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.728325 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.728331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.728335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.728438 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.728856 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.728860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.728862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.729097 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:48.729227 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:48.729833 (+ 606us) server_negotiation.cc:299] Negotiation successful
0812 09:54:48.729992 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 09:54:48.731621 1533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.714052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:43483 (local address 127.11.118.130:40617)
0812 09:54:48.715236 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:48.715293 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:48.716217 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:48.717029 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:48.717041 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:48.717818 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:48.718578 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.718597 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.719626 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.719630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.721487 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.721506 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.722125 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.722132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.722405 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.723278 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:48.723296 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:48.725357 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:48.727812 (+ 2455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.727820 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.727842 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.728192 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.728547 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.728552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.728554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.728736 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.729226 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:48.729236 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:48.729550 (+ 314us) client_negotiation.cc:769] Sending connection context
0812 09:54:48.729772 (+ 222us) client_negotiation.cc:240] Negotiation successful
0812 09:54:48.730173 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"thread_start_us":622,"threads_started":1}
I20260812 09:54:48.733304 1531 heartbeater.cc:347] Connected to a master server at 127.11.118.190:43483
I20260812 09:54:48.733604 1531 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.131@KRBTEST.COM" created.
I20260812 09:54:48.734287 1531 heartbeater.cc:511] Master 127.11.118.190:43483 requested a full tablet report, sending...
I20260812 09:54:48.735697 1145 ts_manager.cc:194] Registered new tserver with Master: 2c942216e2d9434cb8bdc2a13371286a (127.11.118.130:34049)
I20260812 09:54:48.736593 1145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.130@KRBTEST.COM'} at 127.11.118.130:40617
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
Entry for principal kudu/127.11.118.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab.
I20260812 09:54:48.756755 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:46097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:48.882831 1536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:48.883294 1536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:48.883384 1536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:48.887666 1536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:48.887804 1536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:48.887909 1536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:48.893728 1536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:46097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.131.keytab
--principal=kudu/127.11.118.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:48.895067 1536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:48.896209 1536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:48.907634 1541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:48.907644 1542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:48.907711 1536 server_base.cc:1034] running on GCE node
W20260812 09:54:48.907634 1544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:48.908392 1536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:48.909163 1536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:48.910356 1536 hybrid_clock.cc:648] HybridClock initialized: now 1786528488910342 us; error 34 us; skew 500 ppm
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:48.913931 1536 init.cc:377] Logged in from keytab as kudu/127.11.118.131@KRBTEST.COM (short username kudu)
I20260812 09:54:48.915187 1536 webserver.cc:460] Webserver started at http://127.11.118.131:43067/ using document root <none> and password file <none>
I20260812 09:54:48.915831 1536 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:48.915940 1536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:48.916208 1536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:48.918879 1536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "2a62803a182946a5a9f23c97df8f70d8"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "910f675f963033d6ce6ffa7b06aa54a1"
server_key_iv: "e6a4dc16a40eb3d148d893b3803c6610"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.919759 1536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "2a62803a182946a5a9f23c97df8f70d8"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "910f675f963033d6ce6ffa7b06aa54a1"
server_key_iv: "e6a4dc16a40eb3d148d893b3803c6610"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.924525 1536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 09:54:48.927896 1551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.929840 1536 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:48.930064 1536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "2a62803a182946a5a9f23c97df8f70d8"
format_stamp: "Formatted at 2026-08-12 09:54:48 on dist-test-slave-2w3w"
server_key: "910f675f963033d6ce6ffa7b06aa54a1"
server_key_iv: "e6a4dc16a40eb3d148d893b3803c6610"
server_key_version: "encryptionkey@0"
I20260812 09:54:48.930228 1536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:48.947417 1536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:48.952131 1536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:48.952390 1536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:48.953167 1536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:48.954162 1536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:48.954241 1536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.954320 1536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:48.954366 1536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:48.965926 1536 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:38051
I20260812 09:54:48.965946 1685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:38051 every 8 connection(s)
I20260812 09:54:48.967109 1536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:48.976172 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1536
I20260812 09:54:48.976318 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:48.976663 11738 external_mini_cluster.cc:1428] Setting key bb254d75bc1a19fce445d0512c807e8b
Aug 12 09:54:48 dist-test-slave-2w3w krb5kdc[1081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528488, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.131@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:54:48.984644 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.969418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:55171 (local address 127.11.118.190:43483)
0812 09:54:48.969574 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:48.969578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:48.970555 (+ 977us) server_negotiation.cc:407] Connection header received
0812 09:54:48.972623 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:48.972627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:48.972685 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:48.972776 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:48.974302 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.974898 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.976444 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.976806 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.976934 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.980501 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:48.980505 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:48.980507 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:48.980537 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:48.982127 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.982816 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.982819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.982821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.982921 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:48.983432 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:48.983434 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:48.983436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:48.983639 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:48.983723 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:48.984396 (+ 673us) server_negotiation.cc:299] Negotiation successful
0812 09:54:48.984517 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:54:48.985678 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.969773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:43483 (local address 127.11.118.131:55171)
0812 09:54:48.970379 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:48.970431 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:48.972369 (+ 1938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:48.972998 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:48.973006 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:48.973404 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:48.973927 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.973953 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.975203 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.975206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.976223 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:48.976234 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.976990 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.976993 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:48.977253 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.978062 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:54:48.978080 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:48.980264 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:48.982288 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.982295 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.982312 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.982662 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.983113 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:54:48.983116 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:54:48.983117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:54:48.983296 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:54:48.983769 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:48.983776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:48.984082 (+ 306us) client_negotiation.cc:769] Sending connection context
0812 09:54:48.984322 (+ 240us) client_negotiation.cc:240] Negotiation successful
0812 09:54:48.984634 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":137,"threads_started":1}
I20260812 09:54:48.987345 1686 heartbeater.cc:347] Connected to a master server at 127.11.118.190:43483
I20260812 09:54:48.987640 1686 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:48.988226 1686 heartbeater.cc:511] Master 127.11.118.190:43483 requested a full tablet report, sending...
I20260812 09:54:48.989518 1145 ts_manager.cc:194] Registered new tserver with Master: 2a62803a182946a5a9f23c97df8f70d8 (127.11.118.131:38051)
I20260812 09:54:48.990343 1145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.118.131@KRBTEST.COM'} at 127.11.118.131:55171
I20260812 09:54:48.991719 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:49.003505 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:48.994319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51056 (local address 127.11.118.190:43483)
0812 09:54:48.994583 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:48.994587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:48.994613 (+ 26us) server_negotiation.cc:407] Connection header received
0812 09:54:48.994718 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:48.994740 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:48.994795 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:48.994880 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:48.995922 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.996503 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.997622 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:48.997866 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:48.997965 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:48.999665 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:48.999668 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:48.999671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:48.999701 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:49.001334 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:49.001937 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:49.001940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:49.001941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:49.002033 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:49.002400 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:49.002402 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:49.002404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:49.002674 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:49.002795 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.003237 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.003371 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260812 09:54:49.007634 1145 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:49.011032 1145 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:49.028182 1699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.021531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51246 (local address 127.11.118.129:46399)
0812 09:54:49.022331 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.022341 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.022368 (+ 27us) server_negotiation.cc:407] Connection header received
0812 09:54:49.022496 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.022503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.022725 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.022916 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:49.023282 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.024452 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.026196 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.027103 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.027246 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.027400 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.027891 (+ 491us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.028014 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":82,"threads_started":1}
I20260812 09:54:49.028199 1698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.021415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46399 (local address 127.0.0.1:51246)
0812 09:54:49.022098 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.022159 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.022300 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.022905 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.022919 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.022944 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:49.023132 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.023142 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.024590 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.024593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.026075 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.026088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.027498 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.027502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.027647 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.027693 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.027891 (+ 198us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.028045 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":112,"threads_started":1}
I20260812 09:54:49.028960 1702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.022216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:34049 (local address 127.0.0.1:58898)
0812 09:54:49.022920 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.022938 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.023058 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.023659 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.023662 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.023682 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:49.023791 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.023797 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.025156 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.025161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.025989 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.025999 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.028504 (+ 2505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.028510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.028605 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.028637 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.028719 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.028796 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":2,"thread_start_us":129,"threads_started":1}
I20260812 09:54:49.029836 1701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.022426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58898 (local address 127.11.118.130:34049)
0812 09:54:49.023265 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.023276 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.023297 (+ 21us) server_negotiation.cc:407] Connection header received
0812 09:54:49.023379 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.023382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.023520 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.023633 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:49.023931 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.025000 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.026129 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.027103 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.027246 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.027400 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.029542 (+ 2142us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.029674 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":157,"threads_started":1}
I20260812 09:54:49.030151 1700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.022603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:38051 (local address 127.0.0.1:42420)
0812 09:54:49.023836 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.023848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.023976 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.024552 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.024557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.024580 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:49.024683 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.024689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.027119 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.027122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.028321 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.028344 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.029691 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.029695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.029802 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.029838 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.029928 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.030017 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"thread_start_us":94,"threads_started":1}
I20260812 09:54:49.030759 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.022780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42420 (local address 127.11.118.131:38051)
0812 09:54:49.023348 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.023365 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.023979 (+ 614us) server_negotiation.cc:407] Connection header received
0812 09:54:49.024087 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.024092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.024263 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.024395 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:49.024812 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.025939 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.028500 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.029554 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.029693 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.029823 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.030136 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.030620 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":223,"threads_started":1}
I20260812 09:54:49.032158 1289 tablet_service.cc:1467] Processing CreateTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 (DEFAULT_TABLE table=test-table [id=aec64ee9d60147b4b2018ccfb792e2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:49.032552 1451 tablet_service.cc:1467] Processing CreateTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 (DEFAULT_TABLE table=test-table [id=aec64ee9d60147b4b2018ccfb792e2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:49.033293 1289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50f1b7ce4ab40eab17e5b571c355096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:49.033583 1451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50f1b7ce4ab40eab17e5b571c355096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:49.033552 1610 tablet_service.cc:1467] Processing CreateTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 (DEFAULT_TABLE table=test-table [id=aec64ee9d60147b4b2018ccfb792e2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:49.034570 1610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50f1b7ce4ab40eab17e5b571c355096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:49.041270 1704 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Bootstrap starting.
I20260812 09:54:49.043354 1706 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Bootstrap starting.
I20260812 09:54:49.043418 1705 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: Bootstrap starting.
I20260812 09:54:49.044261 1704 tablet_bootstrap.cc:654] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:49.045761 1704 log.cc:824] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:49.045940 1706 tablet_bootstrap.cc:654] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:49.047447 1706 log.cc:824] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:49.047866 1705 tablet_bootstrap.cc:654] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:49.048708 1705 log.cc:824] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:49.049571 1704 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: No bootstrap required, opened a new log
I20260812 09:54:49.049809 1704 ts_tablet_manager.cc:1397] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260812 09:54:49.051709 1706 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: No bootstrap required, opened a new log
I20260812 09:54:49.051827 1705 tablet_bootstrap.cc:492] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: No bootstrap required, opened a new log
I20260812 09:54:49.051950 1706 ts_tablet_manager.cc:1397] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 09:54:49.052148 1705 ts_tablet_manager.cc:1397] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 09:54:49.054219 1704 raft_consensus.cc:348] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.054616 1704 raft_consensus.cc:374] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:49.054677 1704 raft_consensus.cc:729] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c942216e2d9434cb8bdc2a13371286a, State: Initialized, Role: FOLLOWER
I20260812 09:54:49.055296 1704 consensus_queue.cc:260] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.055505 1706 raft_consensus.cc:348] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.055785 1706 raft_consensus.cc:374] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:49.055848 1706 raft_consensus.cc:729] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a62803a182946a5a9f23c97df8f70d8, State: Initialized, Role: FOLLOWER
I20260812 09:54:49.056274 1706 consensus_queue.cc:260] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.056468 1704 ts_tablet_manager.cc:1428] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:54:49.056886 1531 heartbeater.cc:503] Master 127.11.118.190:43483 was elected leader, sending a full tablet report...
I20260812 09:54:49.056975 1686 heartbeater.cc:503] Master 127.11.118.190:43483 was elected leader, sending a full tablet report...
I20260812 09:54:49.057263 1705 raft_consensus.cc:348] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.057576 1705 raft_consensus.cc:374] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:49.057636 1705 raft_consensus.cc:729] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bedfbcadbd64911a3791a7c32103899, State: Initialized, Role: FOLLOWER
I20260812 09:54:49.058112 1705 consensus_queue.cc:260] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.058385 1706 ts_tablet_manager.cc:1428] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 09:54:49.060091 1368 heartbeater.cc:503] Master 127.11.118.190:43483 was elected leader, sending a full tablet report...
I20260812 09:54:49.060360 1705 ts_tablet_manager.cc:1428] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260812 09:54:49.089531 1712 raft_consensus.cc:482] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:49.089954 1712 raft_consensus.cc:504] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.091356 1712 leader_election.cc:288] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c942216e2d9434cb8bdc2a13371286a (127.11.118.130:34049), 2a62803a182946a5a9f23c97df8f70d8 (127.11.118.131:38051)
I20260812 09:54:49.096532 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.092110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:38051 (local address 127.11.118.129:54969)
0812 09:54:49.092598 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.092612 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.092730 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.093002 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.093005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.093021 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:49.093146 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.093152 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.094161 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.094163 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.095168 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.095180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.096081 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.096084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.096161 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.096178 (+ 17us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.096274 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.096360 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":139,"threads_started":1}
I20260812 09:54:49.096516 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.092260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:54969 (local address 127.11.118.131:38051)
0812 09:54:49.092425 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.092430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.092702 (+ 272us) server_negotiation.cc:407] Connection header received
0812 09:54:49.092828 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.092833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.092883 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.092971 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:49.093267 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.094026 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.095330 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.095869 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.095952 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.095995 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.096295 (+ 300us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.096382 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:54:49.096966 1701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.091769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:43099 (local address 127.11.118.130:34049)
0812 09:54:49.092022 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.092028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.092132 (+ 104us) server_negotiation.cc:407] Connection header received
0812 09:54:49.092422 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.092425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.092484 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.092564 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:49.093093 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.093948 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.095573 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.096246 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.096342 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.096390 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.096752 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.096840 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260812 09:54:49.097375 1713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.091674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:34049 (local address 127.11.118.129:43099)
0812 09:54:49.092022 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.092039 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.092231 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.092766 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.092769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.092793 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:49.092952 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.092962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.094080 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.094083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.095399 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.095410 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.096489 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.096493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.096602 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.096622 (+ 20us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.097132 (+ 510us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.097217 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":37,"thread_start_us":153,"threads_started":1}
I20260812 09:54:49.097410 1634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50f1b7ce4ab40eab17e5b571c355096" candidate_uuid: "9bedfbcadbd64911a3791a7c32103899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a62803a182946a5a9f23c97df8f70d8" is_pre_election: true
I20260812 09:54:49.097764 1634 raft_consensus.cc:2454] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bedfbcadbd64911a3791a7c32103899 in term 0.
I20260812 09:54:49.098337 1475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50f1b7ce4ab40eab17e5b571c355096" candidate_uuid: "9bedfbcadbd64911a3791a7c32103899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c942216e2d9434cb8bdc2a13371286a" is_pre_election: true
I20260812 09:54:49.098340 1236 leader_election.cc:302] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a62803a182946a5a9f23c97df8f70d8, 9bedfbcadbd64911a3791a7c32103899; no voters:
I20260812 09:54:49.098634 1475 raft_consensus.cc:2454] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bedfbcadbd64911a3791a7c32103899 in term 0.
I20260812 09:54:49.098657 1712 raft_consensus.cc:2781] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:49.098724 1712 raft_consensus.cc:482] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:49.098767 1712 raft_consensus.cc:3037] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:49.100174 1712 raft_consensus.cc:504] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.100559 1712 leader_election.cc:288] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [CANDIDATE]: Term 1 election: Requested vote from peers 2c942216e2d9434cb8bdc2a13371286a (127.11.118.130:34049), 2a62803a182946a5a9f23c97df8f70d8 (127.11.118.131:38051)
I20260812 09:54:49.101028 1475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50f1b7ce4ab40eab17e5b571c355096" candidate_uuid: "9bedfbcadbd64911a3791a7c32103899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c942216e2d9434cb8bdc2a13371286a"
I20260812 09:54:49.101118 1634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50f1b7ce4ab40eab17e5b571c355096" candidate_uuid: "9bedfbcadbd64911a3791a7c32103899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a62803a182946a5a9f23c97df8f70d8"
I20260812 09:54:49.101236 1475 raft_consensus.cc:3037] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:49.101263 1634 raft_consensus.cc:3037] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:49.102703 1475 raft_consensus.cc:2454] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bedfbcadbd64911a3791a7c32103899 in term 1.
I20260812 09:54:49.102720 1634 raft_consensus.cc:2454] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bedfbcadbd64911a3791a7c32103899 in term 1.
I20260812 09:54:49.103200 1236 leader_election.cc:302] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c942216e2d9434cb8bdc2a13371286a, 9bedfbcadbd64911a3791a7c32103899; no voters:
I20260812 09:54:49.103400 1712 raft_consensus.cc:2781] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:49.103626 1712 raft_consensus.cc:686] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 1 LEADER]: Becoming Leader. State: Replica: 9bedfbcadbd64911a3791a7c32103899, State: Running, Role: LEADER
I20260812 09:54:49.104007 1712 consensus_queue.cc:237] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } }
I20260812 09:54:49.108174 1146 catalog_manager.cc:5495] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bedfbcadbd64911a3791a7c32103899 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "9bedfbcadbd64911a3791a7c32103899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bedfbcadbd64911a3791a7c32103899" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 } health_report { overall_health: UNKNOWN } } }
I20260812 09:54:49.128173 1699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.123534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51250 (local address 127.11.118.129:46399)
0812 09:54:49.123703 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.123707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.123722 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:54:49.123808 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.123811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.123878 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.123980 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:49.124340 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.124937 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.125989 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.126249 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.126367 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.126764 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:49.127362 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:49.127481 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.127967 (+ 486us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.128039 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 09:54:49.136251 1634 raft_consensus.cc:1261] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 1 FOLLOWER]: Refusing update from remote peer 9bedfbcadbd64911a3791a7c32103899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:49.136258 1475 raft_consensus.cc:1261] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 1 FOLLOWER]: Refusing update from remote peer 9bedfbcadbd64911a3791a7c32103899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:49.137722 1712 consensus_queue.cc:1035] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a62803a182946a5a9f23c97df8f70d8" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:49.138029 1716 consensus_queue.cc:1035] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c942216e2d9434cb8bdc2a13371286a" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 34049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:49.147763 1722 mvcc.cc:205] Tried to move back new op lower bound from 7317620691491246080 to 7317620691373039616. Current Snapshot: MvccSnapshot[applied={T|T < 7317620691491246080}]
I20260812 09:54:49.155946 1146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:49.156172 1146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:49.159174 1146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23210a3d731143bc96837ac5fe37eb4e: Sending DeleteTablet for 3 replicas of tablet f50f1b7ce4ab40eab17e5b571c355096
I20260812 09:54:49.160254 1289 tablet_service.cc:1514] Processing DeleteTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:49 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:51246
I20260812 09:54:49.160291 1451 tablet_service.cc:1514] Processing DeleteTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:49 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:58898
I20260812 09:54:49.160501 1610 tablet_service.cc:1514] Processing DeleteTablet for tablet f50f1b7ce4ab40eab17e5b571c355096 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:49 UTC) from {username='kudu', principal='kudu/127.11.118.190@KRBTEST.COM'} at 127.0.0.1:42420
I20260812 09:54:49.161018 1733 tablet_replica.cc:330] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899: stopping tablet replica
I20260812 09:54:49.161363 1732 tablet_replica.cc:330] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: stopping tablet replica
I20260812 09:54:49.161450 1733 raft_consensus.cc:2229] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 1 LEADER]: Raft consensus shutting down.
I20260812 09:54:49.161505 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1216
I20260812 09:54:49.161873 1733 raft_consensus.cc:2258] T f50f1b7ce4ab40eab17e5b571c355096 P 9bedfbcadbd64911a3791a7c32103899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:49.162281 1734 tablet_replica.cc:330] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: stopping tablet replica
I20260812 09:54:49.162583 1732 raft_consensus.cc:2229] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:49.162600 1734 raft_consensus.cc:2229] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:49.162990 1734 raft_consensus.cc:2258] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:49.163028 1732 raft_consensus.cc:2258] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:49.166015 1732 ts_tablet_manager.cc:1905] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:49.168776 1732 ts_tablet_manager.cc:1918] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:49.168926 1732 log.cc:1196] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/f50f1b7ce4ab40eab17e5b571c355096
I20260812 09:54:49.169317 1732 ts_tablet_manager.cc:1939] T f50f1b7ce4ab40eab17e5b571c355096 P 2c942216e2d9434cb8bdc2a13371286a: Deleting consensus metadata
I20260812 09:54:49.170302 1734 ts_tablet_manager.cc:1905] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:49.170996 1126 catalog_manager.cc:4841] TS 2c942216e2d9434cb8bdc2a13371286a (127.11.118.130:34049): tablet f50f1b7ce4ab40eab17e5b571c355096 (table test-table [id=aec64ee9d60147b4b2018ccfb792e2cc]) successfully deleted
W20260812 09:54:49.172545 1130 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:46399 (error 108)
I20260812 09:54:49.173511 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1373
I20260812 09:54:49.173780 1700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.173450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:46399 (local address 127.0.0.1:51256)
0812 09:54:49.173594 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.173674 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:46399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 09:54:49.175423 1734 ts_tablet_manager.cc:1918] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:49.175571 1734 log.cc:1196] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/f50f1b7ce4ab40eab17e5b571c355096
I20260812 09:54:49.175942 1734 ts_tablet_manager.cc:1939] T f50f1b7ce4ab40eab17e5b571c355096 P 2a62803a182946a5a9f23c97df8f70d8: Deleting consensus metadata
I20260812 09:54:49.177493 1126 catalog_manager.cc:4841] TS 2a62803a182946a5a9f23c97df8f70d8 (127.11.118.131:38051): tablet f50f1b7ce4ab40eab17e5b571c355096 (table test-table [id=aec64ee9d60147b4b2018ccfb792e2cc]) successfully deleted
W20260812 09:54:49.177541 1130 catalog_manager.cc:4584] TS 9bedfbcadbd64911a3791a7c32103899 (127.11.118.129:46399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f50f1b7ce4ab40eab17e5b571c355096: Network error: Client connection negotiation failed: client connection to 127.11.118.129:46399: connect: Connection refused (error 111)
I20260812 09:54:49.182905 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1536
I20260812 09:54:49.193477 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1104
2026-08-12T09:54:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2715 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T09:54:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:49Z Disabled control of system clock
I20260812 09:54:49.232583 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38229
--webserver_interface=127.11.118.190
--webserver_port=0
--builtin_ntp_servers=127.11.118.148:41033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:38229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:49.355625 1739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:49.355964 1739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:49.356004 1739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:49.360420 1739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:49.360498 1739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:49.360514 1739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:49.360532 1739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:49.360548 1739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:49.365906 1739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:38229
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:38229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:49.367138 1739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:49.368589 1739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:49.378337 1748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:49.378301 1746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:49.378454 1745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:49.378602 1739 server_base.cc:1034] running on GCE node
I20260812 09:54:49.379637 1739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:49.381114 1739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:49.382328 1739 hybrid_clock.cc:648] HybridClock initialized: now 1786528489382304 us; error 42 us; skew 500 ppm
I20260812 09:54:49.389232 1739 webserver.cc:460] Webserver started at http://127.11.118.190:33791/ using document root <none> and password file <none>
I20260812 09:54:49.389984 1739 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:49.390067 1739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:49.390318 1739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:49.392709 1739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "cf950b5ab5894c30868e4fca7a065cec"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2dd71524b985faf47e980813bba32e80"
server_key_iv: "a483dab16a5d540d57a8c94df2638d02"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.393376 1739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "cf950b5ab5894c30868e4fca7a065cec"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2dd71524b985faf47e980813bba32e80"
server_key_iv: "a483dab16a5d540d57a8c94df2638d02"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.397550 1739 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:49.400398 1755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.401932 1739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:54:49.402129 1739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "cf950b5ab5894c30868e4fca7a065cec"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2dd71524b985faf47e980813bba32e80"
server_key_iv: "a483dab16a5d540d57a8c94df2638d02"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.402276 1739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:49.424367 1739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:49.425236 1739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:49.425478 1739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:49.433799 1739 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:38229
I20260812 09:54:49.433826 1812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:38229 every 8 connection(s)
I20260812 09:54:49.434870 1739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:49.438345 1813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:49.441393 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1739
I20260812 09:54:49.441522 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:49.441867 11738 external_mini_cluster.cc:1428] Setting key 07fd3f0e93afd0de54b22239918904aa
I20260812 09:54:49.444892 1813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: Bootstrap starting.
I20260812 09:54:49.447328 1813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:49.448156 1813 log.cc:824] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:49.450448 1813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: No bootstrap required, opened a new log
I20260812 09:54:49.452108 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.443527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40718 (local address 127.11.118.190:38229)
0812 09:54:49.444314 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.444333 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.444380 (+ 47us) server_negotiation.cc:407] Connection header received
0812 09:54:49.445127 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.445147 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.445580 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.445923 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:49.446386 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.447496 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.448487 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.448990 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.449182 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.450122 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:49.450127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:49.450141 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:49.450641 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:49.450725 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:49.450748 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:49.450860 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.451048 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.451337 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":169,"threads_started":1}
I20260812 09:54:49.454864 1813 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } }
I20260812 09:54:49.455260 1813 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:49.455339 1813 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf950b5ab5894c30868e4fca7a065cec, State: Initialized, Role: FOLLOWER
I20260812 09:54:49.455935 1813 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } }
I20260812 09:54:49.456094 1813 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:49.456141 1813 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:49.456246 1813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:49.457396 1813 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } }
I20260812 09:54:49.457798 1813 leader_election.cc:302] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf950b5ab5894c30868e4fca7a065cec; no voters:
I20260812 09:54:49.458171 1813 leader_election.cc:288] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:49.458482 1818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:49.458702 1818 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [term 1 LEADER]: Becoming Leader. State: Replica: cf950b5ab5894c30868e4fca7a065cec, State: Running, Role: LEADER
I20260812 09:54:49.459074 1818 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } }
I20260812 09:54:49.459653 1813 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:49.461018 1820 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf950b5ab5894c30868e4fca7a065cec. Latest consensus state: current_term: 1 leader_uuid: "cf950b5ab5894c30868e4fca7a065cec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } } }
I20260812 09:54:49.461193 1820 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:49.461021 1819 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf950b5ab5894c30868e4fca7a065cec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf950b5ab5894c30868e4fca7a065cec" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 38229 } } }
I20260812 09:54:49.461491 1819 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec [sys.catalog]: This master's current role is: LEADER
W20260812 09:54:49.464979 1837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:54:49.465062 1837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:54:49.465152 1832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:49.465930 1832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:49.472091 1832 catalog_manager.cc:1347] Generated new cluster ID: 2d74303b30ff461b97800c6ec9feb98f
I20260812 09:54:49.472203 1832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:49.490942 1832 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:49.492044 1832 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:49.498513 1832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: Generated new TSK 0
I20260812 09:54:49.499500 1832 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:49.508052 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.129:0
--local_ip_for_outbound_sockets=127.11.118.129
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--builtin_ntp_servers=127.11.118.148:41033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 09:54:49.636320 1842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:49.636685 1842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:49.636765 1842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:49.641110 1842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:49.641232 1842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:49.641337 1842 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.129
I20260812 09:54:49.646479 1842 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.118.129
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.129
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:49.647786 1842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:49.649326 1842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:49.660986 1848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:49.660972 1847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:49.661301 1842 server_base.cc:1034] running on GCE node
W20260812 09:54:49.660972 1850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:49.662245 1842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:49.663340 1842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:49.664563 1842 hybrid_clock.cc:648] HybridClock initialized: now 1786528489664540 us; error 44 us; skew 500 ppm
I20260812 09:54:49.667338 1842 webserver.cc:460] Webserver started at http://127.11.118.129:41081/ using document root <none> and password file <none>
I20260812 09:54:49.668021 1842 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:49.668130 1842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:49.668399 1842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:49.670785 1842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data/instance:
uuid: "05d5cf39b61146789f39d9283ec03cd3"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2d04af57b83aa40723e3269fac6e03e3"
server_key_iv: "2900540e310de92df5b798debe95dff3"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.671525 1842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance:
uuid: "05d5cf39b61146789f39d9283ec03cd3"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2d04af57b83aa40723e3269fac6e03e3"
server_key_iv: "2900540e310de92df5b798debe95dff3"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.676172 1842 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:49.679493 1858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.680943 1842 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:54:49.681113 1842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal
uuid: "05d5cf39b61146789f39d9283ec03cd3"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "2d04af57b83aa40723e3269fac6e03e3"
server_key_iv: "2900540e310de92df5b798debe95dff3"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.681295 1842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:49.691462 1842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:49.692380 1842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:49.692637 1842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:49.693475 1842 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:49.695026 1842 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:49.695124 1842 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 09:54:49.695199 1842 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:49.695241 1842 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.707273 1842 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.129:44433
I20260812 09:54:49.707305 1990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.129:44433 every 8 connection(s)
I20260812 09:54:49.709054 1842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/data/info.pb
I20260812 09:54:49.718187 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1842
I20260812 09:54:49.718325 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-0/wal/instance
I20260812 09:54:49.718670 11738 external_mini_cluster.cc:1428] Setting key 072e857d92108e2d09c90cb5864429c9
I20260812 09:54:49.720911 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.711405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:53071 (local address 127.11.118.190:38229)
0812 09:54:49.711646 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.711651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.712779 (+ 1128us) server_negotiation.cc:407] Connection header received
0812 09:54:49.715125 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.715128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.715189 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.715274 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:49.716399 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.717015 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.718456 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.718692 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.718816 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.720347 (+ 1531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:49.720351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:49.720354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:49.720369 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:49.720396 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:49.720405 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:49.720504 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.720685 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.720758 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260812 09:54:49.721352 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.130:0
--local_ip_for_outbound_sockets=127.11.118.130
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--builtin_ntp_servers=127.11.118.148:41033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:49.722048 1993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.711716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38229 (local address 127.11.118.129:53071)
0812 09:54:49.712540 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.712602 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.714690 (+ 2088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.715496 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.715505 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.715600 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:49.716194 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.716209 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.717231 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.717234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.718237 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.718249 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.718950 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.718956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.719233 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.720022 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:49.720023 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:49.720074 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:49.720156 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:49.720510 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:49.720523 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:49.720530 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.720687 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.721051 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":174,"threads_started":1}
I20260812 09:54:49.723716 1991 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38229
I20260812 09:54:49.724027 1991 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:49.724797 1991 heartbeater.cc:511] Master 127.11.118.190:38229 requested a full tablet report, sending...
I20260812 09:54:49.727020 1775 ts_manager.cc:194] Registered new tserver with Master: 05d5cf39b61146789f39d9283ec03cd3 (127.11.118.129:44433)
I20260812 09:54:49.728307 1775 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.129:53071
W20260812 09:54:49.845973 1994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:49.846326 1994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:49.846402 1994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:49.850764 1994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:49.850953 1994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:49.851082 1994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.130
I20260812 09:54:49.856314 1994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.118.130
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.130
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:49.857620 1994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:49.859268 1994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:49.870738 2001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:49.870774 2003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:49.870795 2000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:49.871021 1994 server_base.cc:1034] running on GCE node
I20260812 09:54:49.871790 1994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:49.872740 1994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:49.874089 1994 hybrid_clock.cc:648] HybridClock initialized: now 1786528489874025 us; error 63 us; skew 500 ppm
I20260812 09:54:49.876683 1994 webserver.cc:460] Webserver started at http://127.11.118.130:43235/ using document root <none> and password file <none>
I20260812 09:54:49.877363 1994 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:49.877467 1994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:49.877712 1994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:49.880092 1994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data/instance:
uuid: "9e9c7ce354fd44d6a870c90c4f189a08"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "4559742e6628be75067762453e387ad2"
server_key_iv: "b1cb649e2cfab0fa7cd22a6f741690d6"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.880735 1994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance:
uuid: "9e9c7ce354fd44d6a870c90c4f189a08"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "4559742e6628be75067762453e387ad2"
server_key_iv: "b1cb649e2cfab0fa7cd22a6f741690d6"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.885293 1994 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:54:49.888589 2010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.890298 1994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:54:49.890506 1994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal
uuid: "9e9c7ce354fd44d6a870c90c4f189a08"
format_stamp: "Formatted at 2026-08-12 09:54:49 on dist-test-slave-2w3w"
server_key: "4559742e6628be75067762453e387ad2"
server_key_iv: "b1cb649e2cfab0fa7cd22a6f741690d6"
server_key_version: "encryptionkey@0"
I20260812 09:54:49.890661 1994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:49.907455 1994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:49.908293 1994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:49.908519 1994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:49.909207 1994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:49.910243 1994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:49.910316 1994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.910394 1994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:49.910436 1994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:49.920724 1994 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.130:39267
I20260812 09:54:49.921026 2138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.130:39267 every 8 connection(s)
I20260812 09:54:49.921852 1994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/data/info.pb
I20260812 09:54:49.931548 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 1994
I20260812 09:54:49.931720 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal/instance
I20260812 09:54:49.932109 11738 external_mini_cluster.cc:1428] Setting key 6f735e044c02945f2c5d486f141250f8
I20260812 09:54:49.933189 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.924214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.130:34373 (local address 127.11.118.190:38229)
0812 09:54:49.924388 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:49.924392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:49.925507 (+ 1115us) server_negotiation.cc:407] Connection header received
0812 09:54:49.927388 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:49.927392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:49.927464 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:49.927576 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:49.928611 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.929172 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.930464 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.930696 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.930817 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.932456 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:49.932459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:49.932462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:49.932476 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:49.932498 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:49.932529 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:49.932615 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:49.932939 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 09:54:49.933044 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 09:54:49.934801 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.118.131:0
--local_ip_for_outbound_sockets=127.11.118.131
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--builtin_ntp_servers=127.11.118.148:41033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 09:54:49.934705 2141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:49.924496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38229 (local address 127.11.118.130:34373)
0812 09:54:49.925320 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:49.925371 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:49.927113 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:49.927782 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:49.927790 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:49.927917 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:49.928454 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.928468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.929335 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.929337 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.930316 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:49.930327 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:49.930888 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:49.930893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:49.931147 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:49.932064 (+ 917us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:49.932066 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:49.932116 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:49.932220 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:49.932675 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:49.932684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:49.932690 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 09:54:49.932911 (+ 221us) client_negotiation.cc:240] Negotiation successful
0812 09:54:49.933244 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":121,"threads_started":1}
I20260812 09:54:49.936337 2139 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38229
I20260812 09:54:49.936650 2139 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:49.937458 2139 heartbeater.cc:511] Master 127.11.118.190:38229 requested a full tablet report, sending...
I20260812 09:54:49.938932 1775 ts_manager.cc:194] Registered new tserver with Master: 9e9c7ce354fd44d6a870c90c4f189a08 (127.11.118.130:39267)
I20260812 09:54:49.939662 1775 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.130:34373
W20260812 09:54:50.060256 2142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:50.060699 2142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:50.060788 2142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:50.065996 2142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:50.066112 2142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:50.066236 2142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.118.131
I20260812 09:54:50.072109 2142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:41033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.118.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.118.131
--webserver_port=0
--tserver_master_addrs=127.11.118.190:38229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.118.131
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:50.073386 2142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:50.074925 2142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:50.086524 2147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:50.086640 2142 server_base.cc:1034] running on GCE node
W20260812 09:54:50.086596 2148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:50.086516 2150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:50.087392 2142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:50.088153 2142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:50.089376 2142 hybrid_clock.cc:648] HybridClock initialized: now 1786528490089331 us; error 62 us; skew 500 ppm
I20260812 09:54:50.091617 2142 webserver.cc:460] Webserver started at http://127.11.118.131:46109/ using document root <none> and password file <none>
I20260812 09:54:50.092281 2142 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:50.092387 2142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:50.092635 2142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:50.095302 2142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data/instance:
uuid: "53924e54407a453f862a11981187ac6f"
format_stamp: "Formatted at 2026-08-12 09:54:50 on dist-test-slave-2w3w"
server_key: "97371e8e9d6587b399092b394cf09012"
server_key_iv: "e7b91846cdbee5486a77738d56b1c599"
server_key_version: "encryptionkey@0"
I20260812 09:54:50.096043 2142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance:
uuid: "53924e54407a453f862a11981187ac6f"
format_stamp: "Formatted at 2026-08-12 09:54:50 on dist-test-slave-2w3w"
server_key: "97371e8e9d6587b399092b394cf09012"
server_key_iv: "e7b91846cdbee5486a77738d56b1c599"
server_key_version: "encryptionkey@0"
I20260812 09:54:50.100361 2142 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 09:54:50.103380 2157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:50.104899 2142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 09:54:50.105054 2142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal
uuid: "53924e54407a453f862a11981187ac6f"
format_stamp: "Formatted at 2026-08-12 09:54:50 on dist-test-slave-2w3w"
server_key: "97371e8e9d6587b399092b394cf09012"
server_key_iv: "e7b91846cdbee5486a77738d56b1c599"
server_key_version: "encryptionkey@0"
I20260812 09:54:50.105201 2142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:50.119587 2142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:50.120381 2142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:50.120606 2142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:50.121290 2142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 09:54:50.122328 2142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 09:54:50.122408 2142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:50.122480 2142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 09:54:50.122534 2142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:50.133441 2142 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.131:37039
I20260812 09:54:50.133474 2287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.131:37039 every 8 connection(s)
I20260812 09:54:50.134584 2142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/data/info.pb
I20260812 09:54:50.144786 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2142
I20260812 09:54:50.144942 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal/instance
I20260812 09:54:50.145252 11738 external_mini_cluster.cc:1428] Setting key bd1d34a4b74fad99b323011366daba38
I20260812 09:54:50.145779 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.136961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.131:55031 (local address 127.11.118.190:38229)
0812 09:54:50.137140 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.137145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.138494 (+ 1349us) server_negotiation.cc:407] Connection header received
0812 09:54:50.140074 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.140078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.140133 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.140221 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:50.141401 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.142013 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.143455 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.143690 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.143792 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.145174 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:50.145177 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:50.145180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:50.145197 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:50.145218 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:50.145227 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:50.145299 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.145522 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.145594 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 09:54:50.146920 2290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.137355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:38229 (local address 127.11.118.131:55031)
0812 09:54:50.138245 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.138297 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.139792 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.140447 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.140454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.140549 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:54:50.141191 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.141207 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.142217 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.142220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.143315 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.143326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.143868 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.143871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.144056 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.144783 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 09:54:50.144785 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:54:50.144849 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 09:54:50.144956 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:54:50.145332 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:54:50.145342 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:54:50.145349 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.145500 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.145854 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":139,"threads_started":1}
I20260812 09:54:50.148284 2288 heartbeater.cc:347] Connected to a master server at 127.11.118.190:38229
I20260812 09:54:50.148535 2288 heartbeater.cc:464] Registering TS with master...
I20260812 09:54:50.149113 2288 heartbeater.cc:511] Master 127.11.118.190:38229 requested a full tablet report, sending...
I20260812 09:54:50.150345 1772 ts_manager.cc:194] Registered new tserver with Master: 53924e54407a453f862a11981187ac6f (127.11.118.131:37039)
I20260812 09:54:50.151139 1772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.118.131:55031
I20260812 09:54:50.160554 11738 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 09:54:50.167168 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.162942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40720 (local address 127.11.118.190:38229)
0812 09:54:50.163199 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.163203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.163257 (+ 54us) server_negotiation.cc:407] Connection header received
0812 09:54:50.163386 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.163389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.163447 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.163548 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:50.163838 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.164385 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.165327 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.165555 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.165645 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.166588 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:50.166591 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:50.166593 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:50.166607 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:50.166628 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:50.166636 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:50.166703 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.166898 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.167022 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260812 09:54:50.170876 1772 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 09:54:50.174642 1772 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 09:54:50.191715 2304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.185388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:44433 (local address 127.0.0.1:50260)
0812 09:54:50.186269 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.186331 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.186535 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.187273 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.187282 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.187309 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:50.187460 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.187472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.188569 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.188572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.189954 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.189964 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.191099 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.191219 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.191257 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.191389 (+ 132us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.191532 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":58,"spinlock_wait_cycles":215296,"thread_start_us":97,"threads_started":1}
I20260812 09:54:50.191720 2306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.186045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50260 (local address 127.11.118.129:44433)
0812 09:54:50.186399 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.186407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.186435 (+ 28us) server_negotiation.cc:407] Connection header received
0812 09:54:50.186832 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.186838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.187091 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.187241 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:50.187601 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.188418 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.190101 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.190933 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191101 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.191332 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.191421 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.191532 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":129,"threads_started":1}
I20260812 09:54:50.192540 2300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.185143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37039 (local address 127.0.0.1:52712)
0812 09:54:50.186526 (+ 1383us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.186539 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.186687 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.187439 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.187442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.187457 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:50.187579 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.187584 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.189070 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.189073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.190477 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.190487 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.191836 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.192107 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.192171 (+ 64us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.192282 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.192370 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1325,"mutex_wait_us":911,"thread_start_us":102,"threads_started":1}
I20260812 09:54:50.192541 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.185143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39267 (local address 127.0.0.1:60436)
0812 09:54:50.186270 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.186328 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.186494 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.187505 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.187510 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.187533 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:50.187636 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.187644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.189196 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.189200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.190457 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.190467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.191836 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.192109 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.192171 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.192282 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.192369 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":931,"mutex_wait_us":109,"thread_start_us":108,"threads_started":1}
I20260812 09:54:50.195034 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.185457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52712 (local address 127.11.118.131:37039)
0812 09:54:50.186018 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.186031 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.186622 (+ 591us) server_negotiation.cc:407] Connection header received
0812 09:54:50.186839 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.186844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.187090 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.187231 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:50.187706 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.188935 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.190639 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.191460 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191593 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.191762 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.192456 (+ 694us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.192573 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":146,"threads_started":1}
I20260812 09:54:50.195822 2301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.185319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.11.118.130:39267)
0812 09:54:50.186839 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.186857 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.186882 (+ 25us) server_negotiation.cc:407] Connection header received
0812 09:54:50.186992 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.186998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.187178 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.187349 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:50.187768 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.188941 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.190585 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.191460 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.191593 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.191762 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.195464 (+ 3702us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.195625 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1379,"thread_start_us":133,"threads_started":1}
I20260812 09:54:50.195647 1916 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 (DEFAULT_TABLE table=test-table [id=bf73cb30bade4b02b1764b73130b68af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:50.197027 1916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0fc93013c34054bafb7ca1458777e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:50.198504 2216 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 (DEFAULT_TABLE table=test-table [id=bf73cb30bade4b02b1764b73130b68af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:50.198603 2066 tablet_service.cc:1467] Processing CreateTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 (DEFAULT_TABLE table=test-table [id=bf73cb30bade4b02b1764b73130b68af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 09:54:50.199635 2066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0fc93013c34054bafb7ca1458777e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:50.199777 2216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b0fc93013c34054bafb7ca1458777e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:50.205333 2307 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: Bootstrap starting.
I20260812 09:54:50.207156 2308 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Bootstrap starting.
I20260812 09:54:50.210125 2308 tablet_bootstrap.cc:654] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:50.210264 2307 tablet_bootstrap.cc:654] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:50.211059 2308 log.cc:824] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:50.211130 2307 log.cc:824] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:50.211452 2309 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Bootstrap starting.
I20260812 09:54:50.213282 2308 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: No bootstrap required, opened a new log
I20260812 09:54:50.213403 2307 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: No bootstrap required, opened a new log
I20260812 09:54:50.213565 2308 ts_tablet_manager.cc:1397] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 09:54:50.213614 2307 ts_tablet_manager.cc:1397] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260812 09:54:50.214130 2309 tablet_bootstrap.cc:654] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:50.215162 2309 log.cc:824] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:50.217972 2307 raft_consensus.cc:348] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.218012 2308 raft_consensus.cc:348] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.218281 2307 raft_consensus.cc:374] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:50.218287 2308 raft_consensus.cc:374] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:50.218322 2309 tablet_bootstrap.cc:492] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: No bootstrap required, opened a new log
I20260812 09:54:50.218343 2307 raft_consensus.cc:729] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d5cf39b61146789f39d9283ec03cd3, State: Initialized, Role: FOLLOWER
I20260812 09:54:50.218343 2308 raft_consensus.cc:729] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e9c7ce354fd44d6a870c90c4f189a08, State: Initialized, Role: FOLLOWER
I20260812 09:54:50.218549 2309 ts_tablet_manager.cc:1397] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 09:54:50.218863 2307 consensus_queue.cc:260] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.218991 2308 consensus_queue.cc:260] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.219769 1991 heartbeater.cc:503] Master 127.11.118.190:38229 was elected leader, sending a full tablet report...
I20260812 09:54:50.220032 2139 heartbeater.cc:503] Master 127.11.118.190:38229 was elected leader, sending a full tablet report...
I20260812 09:54:50.220700 2308 ts_tablet_manager.cc:1428] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:54:50.221288 2307 ts_tablet_manager.cc:1428] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3: Time spent starting tablet: real 0.008s user 0.008s sys 0.001s
I20260812 09:54:50.223030 2309 raft_consensus.cc:348] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.223315 2309 raft_consensus.cc:374] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:50.223390 2309 raft_consensus.cc:729] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53924e54407a453f862a11981187ac6f, State: Initialized, Role: FOLLOWER
I20260812 09:54:50.223912 2309 consensus_queue.cc:260] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.225085 2288 heartbeater.cc:503] Master 127.11.118.190:38229 was elected leader, sending a full tablet report...
I20260812 09:54:50.225420 2309 ts_tablet_manager.cc:1428] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260812 09:54:50.254354 2315 raft_consensus.cc:482] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 09:54:50.254695 2315 raft_consensus.cc:504] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.256033 2315 leader_election.cc:288] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e9c7ce354fd44d6a870c90c4f189a08 (127.11.118.130:39267), 53924e54407a453f862a11981187ac6f (127.11.118.131:37039)
I20260812 09:54:50.261050 2319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.256350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.131:37039 (local address 127.11.118.129:41847)
0812 09:54:50.256652 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.256668 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.256824 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.257223 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.257226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.257249 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:50.257440 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.257449 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.258407 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.258410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.259533 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.259582 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.260467 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.260471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.260584 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.260630 (+ 46us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.260748 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.260835 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":138,"threads_started":1}
I20260812 09:54:50.261094 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.256494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:41847 (local address 127.11.118.131:37039)
0812 09:54:50.256753 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.256773 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.256799 (+ 26us) server_negotiation.cc:407] Connection header received
0812 09:54:50.256997 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.257000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.257072 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.257178 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:50.257577 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.258238 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.259728 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.260326 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.260467 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.260530 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.260773 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.260859 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 09:54:50.261179 2301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.256728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.118.129:38673 (local address 127.11.118.130:39267)
0812 09:54:50.256872 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.256878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.257183 (+ 305us) server_negotiation.cc:407] Connection header received
0812 09:54:50.257265 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.257269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.257317 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.257399 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 09:54:50.258017 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.258718 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.260044 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.260554 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.260715 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.260843 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.260944 (+ 101us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.261034 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:54:50.261515 2320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.256382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.130:39267 (local address 127.11.118.129:38673)
0812 09:54:50.257019 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.257034 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:54:50.257162 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:54:50.257463 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:54:50.257465 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:54:50.257482 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 09:54:50.257641 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.257648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.258873 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.258876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.259905 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:54:50.259917 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.260691 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.260696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:54:50.260813 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.260837 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 09:54:50.260919 (+ 82us) client_negotiation.cc:240] Negotiation successful
0812 09:54:50.260994 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":79,"threads_started":1}
I20260812 09:54:50.262142 2240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b0fc93013c34054bafb7ca1458777e9" candidate_uuid: "05d5cf39b61146789f39d9283ec03cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53924e54407a453f862a11981187ac6f" is_pre_election: true
I20260812 09:54:50.262341 2090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b0fc93013c34054bafb7ca1458777e9" candidate_uuid: "05d5cf39b61146789f39d9283ec03cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" is_pre_election: true
I20260812 09:54:50.262547 2240 raft_consensus.cc:2454] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5cf39b61146789f39d9283ec03cd3 in term 0.
I20260812 09:54:50.262673 2090 raft_consensus.cc:2454] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d5cf39b61146789f39d9283ec03cd3 in term 0.
I20260812 09:54:50.263199 1862 leader_election.cc:302] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 05d5cf39b61146789f39d9283ec03cd3, 53924e54407a453f862a11981187ac6f, 9e9c7ce354fd44d6a870c90c4f189a08; no voters:
I20260812 09:54:50.263507 2315 raft_consensus.cc:2781] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 09:54:50.263602 2315 raft_consensus.cc:482] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 09:54:50.263645 2315 raft_consensus.cc:3037] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:50.264780 2315 raft_consensus.cc:504] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.265268 2315 leader_election.cc:288] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 9e9c7ce354fd44d6a870c90c4f189a08 (127.11.118.130:39267), 53924e54407a453f862a11981187ac6f (127.11.118.131:37039)
I20260812 09:54:50.265842 2090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b0fc93013c34054bafb7ca1458777e9" candidate_uuid: "05d5cf39b61146789f39d9283ec03cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e9c7ce354fd44d6a870c90c4f189a08"
I20260812 09:54:50.265892 2240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b0fc93013c34054bafb7ca1458777e9" candidate_uuid: "05d5cf39b61146789f39d9283ec03cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53924e54407a453f862a11981187ac6f"
I20260812 09:54:50.266084 2240 raft_consensus.cc:3037] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:50.266095 2090 raft_consensus.cc:3037] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:50.267822 2090 raft_consensus.cc:2454] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5cf39b61146789f39d9283ec03cd3 in term 1.
I20260812 09:54:50.267831 2240 raft_consensus.cc:2454] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d5cf39b61146789f39d9283ec03cd3 in term 1.
I20260812 09:54:50.268282 1863 leader_election.cc:302] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d5cf39b61146789f39d9283ec03cd3, 9e9c7ce354fd44d6a870c90c4f189a08; no voters:
I20260812 09:54:50.268514 2315 raft_consensus.cc:2781] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:50.268812 2315 raft_consensus.cc:686] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [term 1 LEADER]: Becoming Leader. State: Replica: 05d5cf39b61146789f39d9283ec03cd3, State: Running, Role: LEADER
I20260812 09:54:50.269197 2315 consensus_queue.cc:237] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } }
I20260812 09:54:50.272460 1773 catalog_manager.cc:5495] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d5cf39b61146789f39d9283ec03cd3 (127.11.118.129). New cstate: current_term: 1 leader_uuid: "05d5cf39b61146789f39d9283ec03cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05d5cf39b61146789f39d9283ec03cd3" member_type: VOTER last_known_addr { host: "127.11.118.129" port: 44433 } health_report { overall_health: HEALTHY } } }
I20260812 09:54:50.295272 2306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.291260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.11.118.129:44433)
0812 09:54:50.291418 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:50.291423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:50.291441 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:54:50.291566 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:50.291568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:50.291631 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:50.291750 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:54:50.292013 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.292593 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.293540 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:50.293779 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:50.293928 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:50.294274 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:54:50.294776 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:54:50.294925 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:50.295035 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 09:54:50.295110 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:54:50.301918 2240 raft_consensus.cc:1261] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 1 FOLLOWER]: Refusing update from remote peer 05d5cf39b61146789f39d9283ec03cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:50.301918 2090 raft_consensus.cc:1261] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 1 FOLLOWER]: Refusing update from remote peer 05d5cf39b61146789f39d9283ec03cd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:54:50.302738 2321 consensus_queue.cc:1035] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e9c7ce354fd44d6a870c90c4f189a08" member_type: VOTER last_known_addr { host: "127.11.118.130" port: 39267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:50.302953 2315 consensus_queue.cc:1035] T 8b0fc93013c34054bafb7ca1458777e9 P 05d5cf39b61146789f39d9283ec03cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53924e54407a453f862a11981187ac6f" member_type: VOTER last_known_addr { host: "127.11.118.131" port: 37039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:54:50.321626 1773 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:50.321842 1773 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 09:54:50.324700 1773 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf950b5ab5894c30868e4fca7a065cec: Sending DeleteTablet for 3 replicas of tablet 8b0fc93013c34054bafb7ca1458777e9
I20260812 09:54:50.325690 2066 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:50 UTC) from {username='slave'} at 127.0.0.1:60436
I20260812 09:54:50.325732 2216 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:50 UTC) from {username='slave'} at 127.0.0.1:52712
I20260812 09:54:50.325803 1916 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b0fc93013c34054bafb7ca1458777e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 09:54:50 UTC) from {username='slave'} at 127.0.0.1:50260
I20260812 09:54:50.326372 2341 tablet_replica.cc:330] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: stopping tablet replica
I20260812 09:54:50.326640 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1842
I20260812 09:54:50.327306 2341 raft_consensus.cc:2229] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:50.327771 2341 raft_consensus.cc:2258] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:50.328368 2340 tablet_replica.cc:330] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: stopping tablet replica
I20260812 09:54:50.328783 2340 raft_consensus.cc:2229] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 09:54:50.329166 2340 raft_consensus.cc:2258] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 09:54:50.331418 2340 ts_tablet_manager.cc:1905] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:50.331837 2341 ts_tablet_manager.cc:1905] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 09:54:50.334257 2340 ts_tablet_manager.cc:1918] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:50.334448 2340 log.cc:1196] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-1/wal/wals/8b0fc93013c34054bafb7ca1458777e9
I20260812 09:54:50.334806 2340 ts_tablet_manager.cc:1939] T 8b0fc93013c34054bafb7ca1458777e9 P 9e9c7ce354fd44d6a870c90c4f189a08: Deleting consensus metadata
I20260812 09:54:50.335856 2341 ts_tablet_manager.cc:1918] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 09:54:50.335990 2341 log.cc:1196] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Deleting WAL directory at /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786528216186196-11738-0/minicluster-data/ts-2/wal/wals/8b0fc93013c34054bafb7ca1458777e9
I20260812 09:54:50.336253 1760 catalog_manager.cc:4841] TS 9e9c7ce354fd44d6a870c90c4f189a08 (127.11.118.130:39267): tablet 8b0fc93013c34054bafb7ca1458777e9 (table test-table [id=bf73cb30bade4b02b1764b73130b68af]) successfully deleted
I20260812 09:54:50.336361 2341 ts_tablet_manager.cc:1939] T 8b0fc93013c34054bafb7ca1458777e9 P 53924e54407a453f862a11981187ac6f: Deleting consensus metadata
I20260812 09:54:50.337891 1759 catalog_manager.cc:4841] TS 53924e54407a453f862a11981187ac6f (127.11.118.131:37039): tablet 8b0fc93013c34054bafb7ca1458777e9 (table test-table [id=bf73cb30bade4b02b1764b73130b68af]) successfully deleted
W20260812 09:54:50.339860 1756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.118.129:44433 (error 108)
I20260812 09:54:50.340124 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1994
I20260812 09:54:50.352190 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:50.351812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.129:44433 (local address 127.0.0.1:50278)
0812 09:54:50.351982 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 09:54:50.352090 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.129:44433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 09:54:50.352407 1756 catalog_manager.cc:4584] TS 05d5cf39b61146789f39d9283ec03cd3 (127.11.118.129:44433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b0fc93013c34054bafb7ca1458777e9: Network error: Client connection negotiation failed: client connection to 127.11.118.129:44433: connect: Connection refused (error 111)
I20260812 09:54:50.357035 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2142
I20260812 09:54:50.366900 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 1739
2026-08-12T09:54:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1170 ms)
[----------] 6 tests from EncryptionPolicyTest (11672 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:50 dist-test-slave-2w3w krb5kdc[2346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:50 dist-test-slave-2w3w krb5kdc[2346](info): set up 2 sockets
Aug 12 09:54:50 dist-test-slave-2w3w krb5kdc[2346](info): commencing operation
krb5kdc: starting...
W20260812 09:54:51.555799 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:51 dist-test-slave-2w3w krb5kdc[2346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:51.724934 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37015
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:51.869537 2361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:51.869971 2361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:51.870064 2361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:51.874639 2361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:51.874796 2361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:51.874838 2361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:51.874878 2361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:51.874912 2361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:51.883107 2361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37015
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:51.884438 2361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:51.885643 2361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:51.899009 2367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:51.899061 2370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:51.899690 2361 server_base.cc:1034] running on GCE node
W20260812 09:54:51.899009 2366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:51.900913 2361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:51.902417 2361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:51.903817 2361 hybrid_clock.cc:648] HybridClock initialized: now 1786528491903798 us; error 39 us; skew 500 ppm
Aug 12 09:54:51 dist-test-slave-2w3w krb5kdc[2346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528491, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:51.908679 2361 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:51.909947 2361 webserver.cc:460] Webserver started at http://127.0.0.1:46333/ using document root <none> and password file <none>
I20260812 09:54:51.910614 2361 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:51.910723 2361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:51.911039 2361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:51.913759 2361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "b5168d9638494443a32fa8cbd6f53aa9"
format_stamp: "Formatted at 2026-08-12 09:54:51 on dist-test-slave-2w3w"
server_key: "71f8d49f19d7e90c486812f1101e12df"
server_key_iv: "af9a5e24b5fd6749d0fc0ccbc1892ea2"
server_key_version: "encryptionkey@0"
I20260812 09:54:51.915693 2361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "b5168d9638494443a32fa8cbd6f53aa9"
format_stamp: "Formatted at 2026-08-12 09:54:51 on dist-test-slave-2w3w"
server_key: "71f8d49f19d7e90c486812f1101e12df"
server_key_iv: "af9a5e24b5fd6749d0fc0ccbc1892ea2"
server_key_version: "encryptionkey@0"
I20260812 09:54:51.924510 2361 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.002s
I20260812 09:54:51.928339 2377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:51.931872 2361 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260812 09:54:51.932152 2361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "b5168d9638494443a32fa8cbd6f53aa9"
format_stamp: "Formatted at 2026-08-12 09:54:51 on dist-test-slave-2w3w"
server_key: "71f8d49f19d7e90c486812f1101e12df"
server_key_iv: "af9a5e24b5fd6749d0fc0ccbc1892ea2"
server_key_version: "encryptionkey@0"
I20260812 09:54:51.932826 2361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:51.949622 2361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:51.955114 2361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:51.955649 2361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:51.965471 2361 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37015
I20260812 09:54:51.965582 2434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37015 every 8 connection(s)
I20260812 09:54:51.966777 2361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:51.970459 2435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:51.977520 2435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9: Bootstrap starting.
I20260812 09:54:51.977495 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2361
I20260812 09:54:51.977778 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:51.978183 11738 external_mini_cluster.cc:1428] Setting key 5bd2feb533fdc326624238db3a3438f5
I20260812 09:54:51.981343 2435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:51.982739 2435 log.cc:824] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:51.986487 2435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9: No bootstrap required, opened a new log
Aug 12 09:54:51 dist-test-slave-2w3w krb5kdc[2346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 09:54:51.992892 2435 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260812 09:54:51.993265 2435 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:51.993312 2435 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5168d9638494443a32fa8cbd6f53aa9, State: Initialized, Role: FOLLOWER
I20260812 09:54:51.993922 2435 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260812 09:54:51.994086 2435 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:51.994191 2435 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:51.994335 2435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:51.995846 2435 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260812 09:54:51.996332 2435 leader_election.cc:302] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5168d9638494443a32fa8cbd6f53aa9; no voters:
I20260812 09:54:51.996803 2435 leader_election.cc:288] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:51.996976 2440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:51.997292 2440 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [term 1 LEADER]: Becoming Leader. State: Replica: b5168d9638494443a32fa8cbd6f53aa9, State: Running, Role: LEADER
I20260812 09:54:51.997705 2440 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260812 09:54:51.998451 2435 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:52.000322 2441 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5168d9638494443a32fa8cbd6f53aa9. Latest consensus state: current_term: 1 leader_uuid: "b5168d9638494443a32fa8cbd6f53aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } } }
I20260812 09:54:52.000524 2441 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:52.000865 2442 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5168d9638494443a32fa8cbd6f53aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5168d9638494443a32fa8cbd6f53aa9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } } }
I20260812 09:54:52.000974 2442 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:52.001268 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:51.980520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59715 (local address 127.0.0.1:37015)
0812 09:54:51.981272 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:51.981301 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:51.981350 (+ 49us) server_negotiation.cc:407] Connection header received
0812 09:54:51.982291 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:51.982314 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:51.982743 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:51.983248 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:51.984245 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:51.985363 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:51.986351 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:51.987285 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:51.987548 (+ 263us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:51.991940 (+ 4392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:51.991950 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:51.991979 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:51.992094 (+ 115us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:51.995231 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:51.996222 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:51.996230 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:51.996239 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:51.996466 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:51.997189 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:51.997192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:51.997194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:51.997932 (+ 738us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:51.998187 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:51.999495 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0812 09:54:51.999855 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":211,"threads_started":1}
I20260812 09:54:52.001588 2454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:52.005401 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:52.006357 2454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:52.014557 2454 catalog_manager.cc:1347] Generated new cluster ID: 229d69e0e7f44902963c4d61af776880
I20260812 09:54:52.014678 2454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:52.020274 2438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:52.008706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41561 (local address 127.0.0.1:37015)
0812 09:54:52.008837 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:52.008843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:52.008861 (+ 18us) server_negotiation.cc:407] Connection header received
0812 09:54:52.008924 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:52.008927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:52.008980 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:52.009091 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:52.010180 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:52.011459 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:52.012763 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:52.013098 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:52.013220 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:52.015472 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:52.015478 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:52.015481 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:52.015533 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:52.017927 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:52.018725 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:52.018732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:52.018734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:52.018843 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:52.019274 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:52.019277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:52.019279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:52.019515 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:52.019659 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:52.019977 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 09:54:52.020088 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 09:54:52.046525 2454 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:52.048013 2454 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:52.055913 2454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5168d9638494443a32fa8cbd6f53aa9: Generated new TSK 0
I20260812 09:54:52.056936 2454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:52.069233 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2361
W20260812 09:54:52.079735 2344 connection.cc:535] client connection to 127.0.0.1:37015 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37015): Connection reset by peer (error 104)
2026-08-12T09:54:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1702 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:52 dist-test-slave-2w3w krb5kdc[2469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:52 dist-test-slave-2w3w krb5kdc[2469](info): set up 2 sockets
Aug 12 09:54:52 dist-test-slave-2w3w krb5kdc[2469](info): commencing operation
krb5kdc: starting...
W20260812 09:54:53.237756 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:53 dist-test-slave-2w3w krb5kdc[2469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:53.400851 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46331
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:53.525547 2487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:53.525944 2487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:53.526037 2487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:53.530602 2487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:53.530740 2487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:53.530783 2487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:53.530844 2487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:53.530905 2487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:53.536998 2487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46331
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:53.538950 2487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:53.540182 2487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:53.550774 2492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:53.550909 2495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:53.551280 2493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:53.551357 2487 server_base.cc:1034] running on GCE node
I20260812 09:54:53.552033 2487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:53.553340 2487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:53.554694 2487 hybrid_clock.cc:648] HybridClock initialized: now 1786528493554639 us; error 75 us; skew 500 ppm
Aug 12 09:54:53 dist-test-slave-2w3w krb5kdc[2469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528493, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:53.558683 2487 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:53.560020 2487 webserver.cc:460] Webserver started at http://127.0.0.1:33981/ using document root <none> and password file <none>
I20260812 09:54:53.560678 2487 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:53.560784 2487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:53.561064 2487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:53.563541 2487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "b4abf8fe457148f78323410b1b3a958e"
format_stamp: "Formatted at 2026-08-12 09:54:53 on dist-test-slave-2w3w"
server_key: "2f3c6c94f1044998f321ab382f372321"
server_key_iv: "1eaf772b27676bcdaa75a1245689cae0"
server_key_version: "encryptionkey@0"
I20260812 09:54:53.564286 2487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "b4abf8fe457148f78323410b1b3a958e"
format_stamp: "Formatted at 2026-08-12 09:54:53 on dist-test-slave-2w3w"
server_key: "2f3c6c94f1044998f321ab382f372321"
server_key_iv: "1eaf772b27676bcdaa75a1245689cae0"
server_key_version: "encryptionkey@0"
I20260812 09:54:53.570207 2487 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 09:54:53.573513 2503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:53.575500 2487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:53.575726 2487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "b4abf8fe457148f78323410b1b3a958e"
format_stamp: "Formatted at 2026-08-12 09:54:53 on dist-test-slave-2w3w"
server_key: "2f3c6c94f1044998f321ab382f372321"
server_key_iv: "1eaf772b27676bcdaa75a1245689cae0"
server_key_version: "encryptionkey@0"
I20260812 09:54:53.575906 2487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:53.598433 2487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:53.602391 2487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:53.602654 2487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:53.610397 2487 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46331
I20260812 09:54:53.610730 2563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46331 every 8 connection(s)
I20260812 09:54:53.611526 2487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:53.614570 2564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:53.620481 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2487
I20260812 09:54:53.620702 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:53.621042 11738 external_mini_cluster.cc:1428] Setting key 051646bedb2e63b2d90b8112051d090b
I20260812 09:54:53.621564 2564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e: Bootstrap starting.
I20260812 09:54:53.624233 2564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:53.625218 2564 log.cc:824] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:53.627997 2564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e: No bootstrap required, opened a new log
I20260812 09:54:53.631611 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:53.622649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37023 (local address 127.0.0.1:46331)
0812 09:54:53.623158 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:53.623181 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:53.623218 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:54:53.623948 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:53.623966 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:53.624366 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:53.624677 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:53.625074 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:53.626390 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:53.627792 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:53.628409 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:53.628575 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:53.629613 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:53.629619 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:53.629642 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:53.630074 (+ 432us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:53.630141 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:53.630168 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:53.630291 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:53.630545 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 09:54:53.630705 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":193,"threads_started":1}
I20260812 09:54:53.632494 2564 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } }
I20260812 09:54:53.632781 2564 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:53.632851 2564 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4abf8fe457148f78323410b1b3a958e, State: Initialized, Role: FOLLOWER
I20260812 09:54:53.633328 2564 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } }
I20260812 09:54:53.633503 2564 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:53.633600 2564 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:53.633723 2564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:53.634907 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:53.635066 2564 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } }
I20260812 09:54:53.635473 2564 leader_election.cc:302] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4abf8fe457148f78323410b1b3a958e; no voters:
I20260812 09:54:53.635883 2564 leader_election.cc:288] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:53.636027 2570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:53.636312 2570 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [term 1 LEADER]: Becoming Leader. State: Replica: b4abf8fe457148f78323410b1b3a958e, State: Running, Role: LEADER
I20260812 09:54:53.636657 2570 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } }
I20260812 09:54:53.637507 2564 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:53.637959 2571 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4abf8fe457148f78323410b1b3a958e. Latest consensus state: current_term: 1 leader_uuid: "b4abf8fe457148f78323410b1b3a958e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } } }
I20260812 09:54:53.638094 2571 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:53.638464 2574 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4abf8fe457148f78323410b1b3a958e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4abf8fe457148f78323410b1b3a958e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46331 } } }
I20260812 09:54:53.638578 2574 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:53.638528 2580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:53.641927 2580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:53.643640 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:53.637477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42835 (local address 127.0.0.1:46331)
0812 09:54:53.637593 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:53.637598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:53.638608 (+ 1010us) server_negotiation.cc:407] Connection header received
0812 09:54:53.638835 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:53.638839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:53.638903 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:53.638985 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:53.639500 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:53.640363 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:53.641581 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:53.641904 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:53.642028 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:53.643101 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:53.643105 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:53.643107 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:53.643124 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:53.643154 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:53.643167 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:53.643275 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:53.643466 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 09:54:53.643507 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:54:53.648375 2580 catalog_manager.cc:1347] Generated new cluster ID: 8efa06ded882464f80c3d7d3072c8046
I20260812 09:54:53.648473 2580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:53.657272 2580 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:53.658334 2580 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:53.662931 2580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4abf8fe457148f78323410b1b3a958e: Generated new TSK 0
I20260812 09:54:53.663745 2580 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:53.668394 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2487
W20260812 09:54:53.677870 2467 connection.cc:535] client connection to 127.0.0.1:46331 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46331): Connection reset by peer (error 104)
2026-08-12T09:54:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:53 dist-test-slave-2w3w krb5kdc[2599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:53 dist-test-slave-2w3w krb5kdc[2599](info): set up 2 sockets
Aug 12 09:54:53 dist-test-slave-2w3w krb5kdc[2599](info): commencing operation
krb5kdc: starting...
W20260812 09:54:54.827144 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:54 dist-test-slave-2w3w krb5kdc[2599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:54.979776 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39815
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:55.105485 2614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:55.105822 2614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:55.105870 2614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:55.110136 2614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:55.110230 2614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:55.110251 2614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:55.110270 2614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:55.110285 2614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:55.116053 2614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39815
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:55.117218 2614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:55.118330 2614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:55.127420 2620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:55.127419 2619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:55.127633 2614 server_base.cc:1034] running on GCE node
W20260812 09:54:55.127804 2622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:55.128382 2614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:55.129561 2614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:55.130779 2614 hybrid_clock.cc:648] HybridClock initialized: now 1786528495130759 us; error 39 us; skew 500 ppm
Aug 12 09:54:55 dist-test-slave-2w3w krb5kdc[2599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528495, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:55.141460 2614 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:55.142581 2614 webserver.cc:460] Webserver started at http://127.0.0.1:43411/ using document root <none> and password file <none>
I20260812 09:54:55.143267 2614 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:55.143342 2614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:55.143525 2614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:55.146034 2614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "398ab14d8d2c4c98aa202d1f049f8256"
format_stamp: "Formatted at 2026-08-12 09:54:55 on dist-test-slave-2w3w"
server_key: "b1103cb47685f5f76de8e42425855cb1"
server_key_iv: "5c2386900e3c2407d95ed8227302ab3b"
server_key_version: "encryptionkey@0"
I20260812 09:54:55.146638 2614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "398ab14d8d2c4c98aa202d1f049f8256"
format_stamp: "Formatted at 2026-08-12 09:54:55 on dist-test-slave-2w3w"
server_key: "b1103cb47685f5f76de8e42425855cb1"
server_key_iv: "5c2386900e3c2407d95ed8227302ab3b"
server_key_version: "encryptionkey@0"
I20260812 09:54:55.151326 2614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260812 09:54:55.154345 2631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:55.155946 2614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:55.156104 2614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "398ab14d8d2c4c98aa202d1f049f8256"
format_stamp: "Formatted at 2026-08-12 09:54:55 on dist-test-slave-2w3w"
server_key: "b1103cb47685f5f76de8e42425855cb1"
server_key_iv: "5c2386900e3c2407d95ed8227302ab3b"
server_key_version: "encryptionkey@0"
I20260812 09:54:55.156236 2614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:55.161531 2614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:55.165256 2614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:55.165444 2614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:55.173758 2614 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39815
I20260812 09:54:55.173875 2693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39815 every 8 connection(s)
I20260812 09:54:55.174943 2614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:55.178275 2694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:55.178823 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2614
I20260812 09:54:55.179090 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:55.179463 11738 external_mini_cluster.cc:1428] Setting key 9b3a169e5cafdfdd47c2ce0e0faf769b
I20260812 09:54:55.185333 2694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256: Bootstrap starting.
I20260812 09:54:55.185508 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:55.181103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36767 (local address 127.0.0.1:39815)
0812 09:54:55.181597 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:55.181614 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:55.181651 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:54:55.182321 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:55.182339 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:55.182638 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:55.182946 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:55.184027 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:55.184032 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:55.184045 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:55.184070 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:55.184146 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:55.184176 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:55.184307 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:55.184451 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 09:54:55.184657 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":161,"threads_started":1}
I20260812 09:54:55.188032 2694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:55.188838 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:55.189086 2694 log.cc:824] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:55.192252 2694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256: No bootstrap required, opened a new log
I20260812 09:54:55.193328 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:55.191487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37867 (local address 127.0.0.1:39815)
0812 09:54:55.191623 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:55.191628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:55.191812 (+ 184us) server_negotiation.cc:407] Connection header received
0812 09:54:55.191989 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:55.191993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:55.192037 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:55.192128 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:55.192908 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:55.192912 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:55.192915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:55.192927 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:55.192964 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:55.192975 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:55.193073 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:55.193156 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 09:54:55.193201 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 09:54:55.197317 2694 raft_consensus.cc:348] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } }
I20260812 09:54:55.197690 2694 raft_consensus.cc:374] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:55.197759 2694 raft_consensus.cc:729] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398ab14d8d2c4c98aa202d1f049f8256, State: Initialized, Role: FOLLOWER
I20260812 09:54:55.198197 2694 consensus_queue.cc:260] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } }
I20260812 09:54:55.198330 2694 raft_consensus.cc:388] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:55.198524 2694 raft_consensus.cc:482] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:55.198772 2694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:55.200332 2694 raft_consensus.cc:504] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } }
I20260812 09:54:55.200713 2694 leader_election.cc:302] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 398ab14d8d2c4c98aa202d1f049f8256; no voters:
I20260812 09:54:55.201098 2694 leader_election.cc:288] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:55.201246 2706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:55.201501 2706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [term 1 LEADER]: Becoming Leader. State: Replica: 398ab14d8d2c4c98aa202d1f049f8256, State: Running, Role: LEADER
I20260812 09:54:55.202015 2706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } }
I20260812 09:54:55.202689 2694 sys_catalog.cc:564] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:55.204253 2707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "398ab14d8d2c4c98aa202d1f049f8256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } } }
I20260812 09:54:55.204313 2709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 398ab14d8d2c4c98aa202d1f049f8256. Latest consensus state: current_term: 1 leader_uuid: "398ab14d8d2c4c98aa202d1f049f8256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "398ab14d8d2c4c98aa202d1f049f8256" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39815 } } }
I20260812 09:54:55.204411 2707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:55.204435 2709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:55.205042 2717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:55.209143 2717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:55.215937 2717 catalog_manager.cc:1347] Generated new cluster ID: 04988f8297604ee08e1cb6957675a292
I20260812 09:54:55.216041 2717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:55.243871 2717 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:55.244339 2717 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:55.254993 2717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 398ab14d8d2c4c98aa202d1f049f8256: Generated new TSK 0
I20260812 09:54:55.255980 2717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:55.261296 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2614
2026-08-12T09:54:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:55 dist-test-slave-2w3w krb5kdc[2730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:55 dist-test-slave-2w3w krb5kdc[2730](info): set up 2 sockets
Aug 12 09:54:55 dist-test-slave-2w3w krb5kdc[2730](info): commencing operation
krb5kdc: starting...
W20260812 09:54:56.419142 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:56.574751 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44055
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:56.704340 2746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:56.704730 2746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:56.704818 2746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:56.709203 2746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:56.709336 2746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:56.709378 2746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:56.709431 2746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:56.709470 2746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:56.715289 2746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:56.716573 2746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:56.717679 2746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:56.727963 2753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:56.728014 2755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:56.728212 2746 server_base.cc:1034] running on GCE node
W20260812 09:54:56.728495 2752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:56.729173 2746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:56.730417 2746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:56.731655 2746 hybrid_clock.cc:648] HybridClock initialized: now 1786528496731642 us; error 28 us; skew 500 ppm
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:56.735002 2746 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:56.736106 2746 webserver.cc:460] Webserver started at http://127.0.0.1:41491/ using document root <none> and password file <none>
I20260812 09:54:56.736755 2746 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:56.736861 2746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:56.737129 2746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:56.739555 2746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "d09a31bade88456b8eb38467949f613a"
format_stamp: "Formatted at 2026-08-12 09:54:56 on dist-test-slave-2w3w"
server_key: "e0e76c1ce2be39f1bf25e29c80f018e2"
server_key_iv: "d460898ed3d281561ad9c125cd7fe590"
server_key_version: "encryptionkey@0"
I20260812 09:54:56.740180 2746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "d09a31bade88456b8eb38467949f613a"
format_stamp: "Formatted at 2026-08-12 09:54:56 on dist-test-slave-2w3w"
server_key: "e0e76c1ce2be39f1bf25e29c80f018e2"
server_key_iv: "d460898ed3d281561ad9c125cd7fe590"
server_key_version: "encryptionkey@0"
I20260812 09:54:56.744264 2746 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 09:54:56.747073 2763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:56.748597 2746 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:56.748781 2746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "d09a31bade88456b8eb38467949f613a"
format_stamp: "Formatted at 2026-08-12 09:54:56 on dist-test-slave-2w3w"
server_key: "e0e76c1ce2be39f1bf25e29c80f018e2"
server_key_iv: "d460898ed3d281561ad9c125cd7fe590"
server_key_version: "encryptionkey@0"
I20260812 09:54:56.748924 2746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:56.765408 2746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:56.768908 2746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:56.769145 2746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:56.777434 2746 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44055
I20260812 09:54:56.777467 2830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44055 every 8 connection(s)
I20260812 09:54:56.778501 2746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:56.781507 2831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:56.784061 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2746
I20260812 09:54:56.784224 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:56.784539 11738 external_mini_cluster.cc:1428] Setting key cacd4636c89413db950fc8b6aada32c8
I20260812 09:54:56.788443 2831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: Bootstrap starting.
I20260812 09:54:56.791097 2831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:56.791934 2831 log.cc:824] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 09:54:56.794941 2831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: No bootstrap required, opened a new log
I20260812 09:54:56.800360 2831 raft_consensus.cc:348] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260812 09:54:56.800762 2831 raft_consensus.cc:374] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:56.800834 2831 raft_consensus.cc:729] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d09a31bade88456b8eb38467949f613a, State: Initialized, Role: FOLLOWER
I20260812 09:54:56.801374 2831 consensus_queue.cc:260] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260812 09:54:56.801545 2831 raft_consensus.cc:388] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:56.801616 2831 raft_consensus.cc:482] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:56.801713 2831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:56.801972 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:56.786111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45559 (local address 127.0.0.1:44055)
0812 09:54:56.786604 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:56.786619 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:56.786656 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:54:56.787576 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:56.787598 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:56.788041 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:56.788449 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:56.789315 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:56.790397 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:56.791507 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:56.792029 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:56.792223 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:56.795566 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:56.795573 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:56.795590 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:56.795626 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:56.798006 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:56.798570 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:56.798577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:56.798585 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:56.798748 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:56.799308 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:56.799312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:56.799314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:56.799982 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:56.800214 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:56.800552 (+ 338us) server_negotiation.cc:299] Negotiation successful
0812 09:54:56.800899 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":170,"threads_started":1}
I20260812 09:54:56.802884 2831 raft_consensus.cc:504] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260812 09:54:56.803297 2831 leader_election.cc:302] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d09a31bade88456b8eb38467949f613a; no voters:
I20260812 09:54:56.803653 2831 leader_election.cc:288] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:56.803822 2837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:56.804466 2837 raft_consensus.cc:686] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [term 1 LEADER]: Becoming Leader. State: Replica: d09a31bade88456b8eb38467949f613a, State: Running, Role: LEADER
I20260812 09:54:56.804924 2837 consensus_queue.cc:237] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260812 09:54:56.805143 2831 sys_catalog.cc:564] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:56.805486 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:56.806767 2838 sys_catalog.cc:455] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d09a31bade88456b8eb38467949f613a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } } }
I20260812 09:54:56.806912 2838 sys_catalog.cc:458] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:56.807318 2839 sys_catalog.cc:455] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d09a31bade88456b8eb38467949f613a. Latest consensus state: current_term: 1 leader_uuid: "d09a31bade88456b8eb38467949f613a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d09a31bade88456b8eb38467949f613a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } } }
I20260812 09:54:56.807451 2839 sys_catalog.cc:458] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a [sys.catalog]: This master's current role is: LEADER
W20260812 09:54:56.810747 2858 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:54:56.810877 2858 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:54:56.810943 2854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:56.811797 2854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:56.819248 2835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:56.808336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55255 (local address 127.0.0.1:44055)
0812 09:54:56.808475 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:56.808480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:56.809061 (+ 581us) server_negotiation.cc:407] Connection header received
0812 09:54:56.809154 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:56.809158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:56.809208 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:56.809298 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:56.810292 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:56.811106 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:56.812477 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:56.812836 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:56.812961 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:56.815208 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:56.815215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:56.815218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:54:56.815255 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:56.817146 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:56.817824 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:56.817828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:56.817830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:56.817980 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:54:56.818291 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:54:56.818294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:54:56.818296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:54:56.818505 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:56.818649 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:56.818911 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 09:54:56.819074 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 09:54:56.819618 2854 catalog_manager.cc:1347] Generated new cluster ID: 2b25f8b76b6c49f8bfd4b6e7ed629929
I20260812 09:54:56.819695 2854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:56.833662 2854 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:56.835244 2854 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:56.842866 2854 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d09a31bade88456b8eb38467949f613a: Generated new TSK 0
I20260812 09:54:56.843883 2854 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:56.852406 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2746
2026-08-12T09:54:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2865](info): set up 2 sockets
Aug 12 09:54:56 dist-test-slave-2w3w krb5kdc[2865](info): commencing operation
krb5kdc: starting...
W20260812 09:54:58.012146 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:58 dist-test-slave-2w3w krb5kdc[2865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:58.164285 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36391
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:58.294449 2880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:58.294862 2880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:58.295276 2880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:58.300244 2880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:58.300372 2880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:58.300410 2880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:58.300473 2880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:58.300530 2880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:58.306734 2880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36391
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:58.308015 2880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:58.309137 2880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:58.319203 2887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:58.319203 2886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:58.319391 2889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:58.319829 2880 server_base.cc:1034] running on GCE node
I20260812 09:54:58.320775 2880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:58.321993 2880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:58.323252 2880 hybrid_clock.cc:648] HybridClock initialized: now 1786528498323202 us; error 77 us; skew 500 ppm
Aug 12 09:54:58 dist-test-slave-2w3w krb5kdc[2865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:58.326809 2880 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:58.327916 2880 webserver.cc:460] Webserver started at http://127.0.0.1:38293/ using document root <none> and password file <none>
I20260812 09:54:58.328686 2880 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:58.328817 2880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:58.329087 2880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:58.331462 2880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "6ccfbc857f8d4dd9b87cb420e08923a9"
format_stamp: "Formatted at 2026-08-12 09:54:58 on dist-test-slave-2w3w"
server_key: "9f487f5da84c002a82269aa79003b67f"
server_key_iv: "6da8896d0fae053159f9b1417b25991e"
server_key_version: "encryptionkey@0"
I20260812 09:54:58.332088 2880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "6ccfbc857f8d4dd9b87cb420e08923a9"
format_stamp: "Formatted at 2026-08-12 09:54:58 on dist-test-slave-2w3w"
server_key: "9f487f5da84c002a82269aa79003b67f"
server_key_iv: "6da8896d0fae053159f9b1417b25991e"
server_key_version: "encryptionkey@0"
I20260812 09:54:58.336262 2880 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:58.339457 2897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:58.341529 2880 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:54:58.341724 2880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "6ccfbc857f8d4dd9b87cb420e08923a9"
format_stamp: "Formatted at 2026-08-12 09:54:58 on dist-test-slave-2w3w"
server_key: "9f487f5da84c002a82269aa79003b67f"
server_key_iv: "6da8896d0fae053159f9b1417b25991e"
server_key_version: "encryptionkey@0"
I20260812 09:54:58.341881 2880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:58.357362 2880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:58.361243 2880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:58.361485 2880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:58.369410 2880 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36391
I20260812 09:54:58.369483 2957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36391 every 8 connection(s)
I20260812 09:54:58.370513 2880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:58.373600 2958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:58.373649 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 2880
I20260812 09:54:58.373793 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:58.374090 11738 external_mini_cluster.cc:1428] Setting key b562557782662a00a80cb08dba299c55
I20260812 09:54:58.380442 2958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9: Bootstrap starting.
I20260812 09:54:58.383402 2958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:58.384276 2958 log.cc:824] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:58.385658 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:58.375701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51291 (local address 127.0.0.1:36391)
0812 09:54:58.376512 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:58.376536 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:58.376603 (+ 67us) server_negotiation.cc:407] Connection header received
0812 09:54:58.377575 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:58.377601 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:58.378155 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:58.378844 (+ 689us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:58.379516 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:58.380630 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:58.381652 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:58.382160 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:58.382351 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:58.383589 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:58.383596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:58.383618 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:58.384061 (+ 443us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:58.384125 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:58.384150 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:58.384273 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:58.384468 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 09:54:58.384700 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":158,"threads_started":1}
I20260812 09:54:58.386809 2958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9: No bootstrap required, opened a new log
I20260812 09:54:58.388871 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:58.391986 2958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } }
I20260812 09:54:58.392359 2958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:58.392419 2958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccfbc857f8d4dd9b87cb420e08923a9, State: Initialized, Role: FOLLOWER
I20260812 09:54:58.392932 2958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } }
I20260812 09:54:58.393117 2958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:58.393220 2958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:58.393334 2958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:58.394611 2958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } }
I20260812 09:54:58.395149 2958 leader_election.cc:302] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ccfbc857f8d4dd9b87cb420e08923a9; no voters:
I20260812 09:54:58.395772 2958 leader_election.cc:288] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:58.395951 2971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:58.396257 2971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccfbc857f8d4dd9b87cb420e08923a9, State: Running, Role: LEADER
I20260812 09:54:58.396301 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:58.391337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38107 (local address 127.0.0.1:36391)
0812 09:54:58.391495 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:58.391500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:58.391631 (+ 131us) server_negotiation.cc:407] Connection header received
0812 09:54:58.391717 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:58.391720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:58.391772 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:58.391874 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:58.392137 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:58.392943 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:58.394042 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:54:58.394444 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:54:58.394568 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:54:58.395707 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:58.395714 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:58.395719 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:58.395737 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:58.395771 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:58.395786 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:58.395876 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:58.396087 (+ 211us) server_negotiation.cc:299] Negotiation successful
0812 09:54:58.396155 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 09:54:58.397212 2971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } }
I20260812 09:54:58.397349 2958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:58.398912 2975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ccfbc857f8d4dd9b87cb420e08923a9. Latest consensus state: current_term: 1 leader_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } } }
I20260812 09:54:58.399008 2972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ccfbc857f8d4dd9b87cb420e08923a9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36391 } } }
I20260812 09:54:58.399114 2975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:58.399128 2972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9 [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:58.399572 2986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:58.403126 2986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:58.410061 2986 catalog_manager.cc:1347] Generated new cluster ID: d7e39ff967b64ec59e950558aa4fb59f
I20260812 09:54:58.410169 2986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:54:58.445343 2986 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:54:58.446508 2986 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:54:58.461493 2986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ccfbc857f8d4dd9b87cb420e08923a9: Generated new TSK 0
I20260812 09:54:58.462368 2986 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:54:58.470572 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 2880
2026-08-12T09:54:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:54:58 dist-test-slave-2w3w krb5kdc[2997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:54:58 dist-test-slave-2w3w krb5kdc[2997](info): set up 2 sockets
Aug 12 09:54:58 dist-test-slave-2w3w krb5kdc[2997](info): commencing operation
krb5kdc: starting...
W20260812 09:54:59.608925 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:54:59 dist-test-slave-2w3w krb5kdc[2997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:54:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:54:59.763080 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36795
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36795
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:54:59.886571 3011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:54:59.886960 3011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:54:59.887074 3011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:54:59.891453 3011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:54:59.891577 3011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:54:59.891614 3011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:54:59.891655 3011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:54:59.891686 3011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:54:59.897459 3011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:54:59.899305 3011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:54:59.900612 3011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:54:59.910801 3019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:59.910802 3017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:54:59.910854 3016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:54:59.910903 3011 server_base.cc:1034] running on GCE node
I20260812 09:54:59.911757 3011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:54:59.913100 3011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:54:59.914395 3011 hybrid_clock.cc:648] HybridClock initialized: now 1786528499914386 us; error 37 us; skew 500 ppm
Aug 12 09:54:59 dist-test-slave-2w3w krb5kdc[2997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528499, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:54:59.917733 3011 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:54:59.918759 3011 webserver.cc:460] Webserver started at http://127.0.0.1:40319/ using document root <none> and password file <none>
I20260812 09:54:59.919402 3011 fs_manager.cc:359] Metadata directory not provided
I20260812 09:54:59.919477 3011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:54:59.919660 3011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:54:59.921838 3011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "ee29371fcb154236a4049493995e01bc"
format_stamp: "Formatted at 2026-08-12 09:54:59 on dist-test-slave-2w3w"
server_key: "5bb60e3a9c0911aadd04ec1a9284666f"
server_key_iv: "22221ed4e9be8ee1267eeb33357abfcd"
server_key_version: "encryptionkey@0"
I20260812 09:54:59.922411 3011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "ee29371fcb154236a4049493995e01bc"
format_stamp: "Formatted at 2026-08-12 09:54:59 on dist-test-slave-2w3w"
server_key: "5bb60e3a9c0911aadd04ec1a9284666f"
server_key_iv: "22221ed4e9be8ee1267eeb33357abfcd"
server_key_version: "encryptionkey@0"
I20260812 09:54:59.926745 3011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 09:54:59.929615 3027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:54:59.931285 3011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:54:59.931484 3011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "ee29371fcb154236a4049493995e01bc"
format_stamp: "Formatted at 2026-08-12 09:54:59 on dist-test-slave-2w3w"
server_key: "5bb60e3a9c0911aadd04ec1a9284666f"
server_key_iv: "22221ed4e9be8ee1267eeb33357abfcd"
server_key_version: "encryptionkey@0"
I20260812 09:54:59.931631 3011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:54:59.937443 3011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:54:59.941733 3011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:54:59.942008 3011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:54:59.950362 3011 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36795
I20260812 09:54:59.950371 3087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36795 every 8 connection(s)
I20260812 09:54:59.951592 3011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:54:59.951982 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3011
I20260812 09:54:59.952154 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:54:59.952519 11738 external_mini_cluster.cc:1428] Setting key 719c2410b6233b80f72ec630b8ae4c45
I20260812 09:54:59.954864 3088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:54:59.958609 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:59.954084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49453 (local address 127.0.0.1:36795)
0812 09:54:59.954645 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:59.954661 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:59.954698 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:54:59.955517 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:59.955535 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:59.955856 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:59.956191 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:59.957200 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:59.957205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:59.957217 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:59.957229 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:59.957295 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:59.957319 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:59.957453 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:59.957579 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 09:54:59.957830 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":266,"threads_started":1}
I20260812 09:54:59.962265 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:54:59.962281 3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc: Bootstrap starting.
I20260812 09:54:59.965073 3088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc: Neither blocks nor log segments found. Creating new log.
I20260812 09:54:59.966090 3088 log.cc:824] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc: Log is configured to *not* fsync() on all Append() calls
I20260812 09:54:59.967069 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:54:59.964798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35451 (local address 127.0.0.1:36795)
0812 09:54:59.964975 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 09:54:59.964979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:54:59.965273 (+ 294us) server_negotiation.cc:407] Connection header received
0812 09:54:59.965371 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:54:59.965375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:54:59.965420 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:54:59.965501 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:54:59.966533 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:54:59.966536 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:54:59.966538 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:54:59.966550 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:54:59.966579 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:54:59.966618 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:54:59.966726 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:54:59.966820 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 09:54:59.966869 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 09:54:59.968798 3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc: No bootstrap required, opened a new log
I20260812 09:54:59.973382 3088 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } }
I20260812 09:54:59.973708 3088 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:54:59.973781 3088 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee29371fcb154236a4049493995e01bc, State: Initialized, Role: FOLLOWER
I20260812 09:54:59.974229 3088 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } }
I20260812 09:54:59.974406 3088 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:54:59.974505 3088 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:54:59.974640 3088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:54:59.976265 3088 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } }
I20260812 09:54:59.976675 3088 leader_election.cc:302] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee29371fcb154236a4049493995e01bc; no voters:
I20260812 09:54:59.977066 3088 leader_election.cc:288] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:54:59.977245 3102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:54:59.977620 3102 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [term 1 LEADER]: Becoming Leader. State: Replica: ee29371fcb154236a4049493995e01bc, State: Running, Role: LEADER
I20260812 09:54:59.978082 3102 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } }
I20260812 09:54:59.978917 3088 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:54:59.980247 3103 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee29371fcb154236a4049493995e01bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } } }
I20260812 09:54:59.980195 3104 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee29371fcb154236a4049493995e01bc. Latest consensus state: current_term: 1 leader_uuid: "ee29371fcb154236a4049493995e01bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee29371fcb154236a4049493995e01bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36795 } } }
I20260812 09:54:59.980505 3104 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:59.980504 3103 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc [sys.catalog]: This master's current role is: LEADER
I20260812 09:54:59.980960 3111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:54:59.984635 3111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:54:59.991930 3111 catalog_manager.cc:1347] Generated new cluster ID: ab8714c21bac430dbde1015d043d3a2c
I20260812 09:54:59.992030 3111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:00.038264 3111 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:00.038666 3111 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:00.045148 3111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee29371fcb154236a4049493995e01bc: Generated new TSK 0
I20260812 09:55:00.045992 3111 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:00.053833 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3011
2026-08-12T09:55:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:00 dist-test-slave-2w3w krb5kdc[3123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:00 dist-test-slave-2w3w krb5kdc[3123](info): set up 2 sockets
Aug 12 09:55:00 dist-test-slave-2w3w krb5kdc[3123](info): commencing operation
krb5kdc: starting...
W20260812 09:55:01.223115 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:01.372262 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39159
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:01.494342 3137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:01.494751 3137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:01.494846 3137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:01.499183 3137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:01.499332 3137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:01.499370 3137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:01.499408 3137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:01.499431 3137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:01.505887 3137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:01.507226 3137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:01.508387 3137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:01.517899 3144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:01.517982 3142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:01.517971 3147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:01.518471 3137 server_base.cc:1034] running on GCE node
I20260812 09:55:01.519212 3137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:01.520457 3137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:01.521637 3137 hybrid_clock.cc:648] HybridClock initialized: now 1786528501521600 us; error 52 us; skew 500 ppm
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528501, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:01.524943 3137 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:01.526033 3137 webserver.cc:460] Webserver started at http://127.0.0.1:35323/ using document root <none> and password file <none>
I20260812 09:55:01.526692 3137 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:01.526798 3137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:01.527119 3137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:01.529376 3137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "042f12dd3de74d948c47a4ffef127042"
format_stamp: "Formatted at 2026-08-12 09:55:01 on dist-test-slave-2w3w"
server_key: "1a371838c061e555238dd9931c56e482"
server_key_iv: "39473b414ae8b21d1d16afaece9956d9"
server_key_version: "encryptionkey@0"
I20260812 09:55:01.530000 3137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "042f12dd3de74d948c47a4ffef127042"
format_stamp: "Formatted at 2026-08-12 09:55:01 on dist-test-slave-2w3w"
server_key: "1a371838c061e555238dd9931c56e482"
server_key_iv: "39473b414ae8b21d1d16afaece9956d9"
server_key_version: "encryptionkey@0"
I20260812 09:55:01.534446 3137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260812 09:55:01.537290 3157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:01.538887 3137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 09:55:01.539320 3137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "042f12dd3de74d948c47a4ffef127042"
format_stamp: "Formatted at 2026-08-12 09:55:01 on dist-test-slave-2w3w"
server_key: "1a371838c061e555238dd9931c56e482"
server_key_iv: "39473b414ae8b21d1d16afaece9956d9"
server_key_version: "encryptionkey@0"
I20260812 09:55:01.539481 3137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:01.553354 3137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:01.557595 3137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:01.557864 3137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:01.566517 3137 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39159
I20260812 09:55:01.566530 3216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39159 every 8 connection(s)
I20260812 09:55:01.567755 3137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:01.571321 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3137
I20260812 09:55:01.571497 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:01.571918 3217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:01.571931 11738 external_mini_cluster.cc:1428] Setting key 301d3212ea4bcf7f09a7f3b9367ccea8
I20260812 09:55:01.581233 3217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: Bootstrap starting.
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 09:55:01.584375 3217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:01.585465 3217 log.cc:824] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:01.588277 3217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: No bootstrap required, opened a new log
I20260812 09:55:01.590677 3221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:01.573509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:34489 (local address 127.0.0.1:39159)
0812 09:55:01.574124 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:01.574147 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:01.574186 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:55:01.575063 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:01.575085 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:01.575480 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:01.575808 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:01.577007 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:01.578309 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:01.579649 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:01.580255 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:01.580407 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:01.584283 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:01.584294 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:01.584317 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:01.584366 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:01.586512 (+ 2146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:01.587423 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:01.587429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:01.587436 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:01.587589 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:01.588020 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:01.588024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:01.588025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:01.588573 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:01.588800 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:01.589146 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 09:55:01.589401 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":163,"threads_started":1}
I20260812 09:55:01.592553 3217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } }
I20260812 09:55:01.592850 3217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:01.592932 3217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 042f12dd3de74d948c47a4ffef127042, State: Initialized, Role: FOLLOWER
I20260812 09:55:01.593448 3217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } }
I20260812 09:55:01.593614 3217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:01.593688 3217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:01.593809 3217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:01.594475 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:01.595224 3217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } }
I20260812 09:55:01.595610 3217 leader_election.cc:302] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 042f12dd3de74d948c47a4ffef127042; no voters:
I20260812 09:55:01.595988 3217 leader_election.cc:288] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:01.596215 3226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:01.596522 3226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [term 1 LEADER]: Becoming Leader. State: Replica: 042f12dd3de74d948c47a4ffef127042, State: Running, Role: LEADER
I20260812 09:55:01.596935 3226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } }
I20260812 09:55:01.597532 3217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:01.598423 3226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 042f12dd3de74d948c47a4ffef127042. Latest consensus state: current_term: 1 leader_uuid: "042f12dd3de74d948c47a4ffef127042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } } }
I20260812 09:55:01.598645 3226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:01.598860 3229 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "042f12dd3de74d948c47a4ffef127042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042f12dd3de74d948c47a4ffef127042" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39159 } } }
I20260812 09:55:01.599155 3229 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042 [sys.catalog]: This master's current role is: LEADER
W20260812 09:55:01.603130 3246 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:01.603230 3246 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:01.603315 3240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:01.604245 3240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:01.606985 3221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:01.596930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:51771 (local address 127.0.0.1:39159)
0812 09:55:01.597043 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:01.597048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:01.597526 (+ 478us) server_negotiation.cc:407] Connection header received
0812 09:55:01.597684 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:01.597688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:01.597739 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:01.597821 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:01.598818 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:01.599691 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:01.600931 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:01.601264 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:01.601375 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:01.603147 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:01.603151 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:01.603154 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:01.603187 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:01.604865 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:01.605419 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:01.605423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:01.605425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:01.605519 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:01.605870 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:01.605873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:01.605875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:01.606076 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:01.606238 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:01.606567 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 09:55:01.606672 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 09:55:01.611820 3240 catalog_manager.cc:1347] Generated new cluster ID: 0d805ffbed0e4394a858b3f9a8cf8b40
I20260812 09:55:01.611913 3240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:01.624459 3240 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:01.625526 3240 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:01.630609 3240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 042f12dd3de74d948c47a4ffef127042: Generated new TSK 0
I20260812 09:55:01.631480 3240 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:01.639250 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3137
W20260812 09:55:01.651122 3121 connection.cc:535] client connection to 127.0.0.1:39159 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39159): Connection reset by peer (error 104)
2026-08-12T09:55:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1589 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3254](info): set up 2 sockets
Aug 12 09:55:01 dist-test-slave-2w3w krb5kdc[3254](info): commencing operation
krb5kdc: starting...
W20260812 09:55:02.804677 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:02 dist-test-slave-2w3w krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:02.959903 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:03.087566 3268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:03.087914 3268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:03.087961 3268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:03.092314 3268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:03.092424 3268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:03.092445 3268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:03.092463 3268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:03.092479 3268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:03.098366 3268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:03.099726 3268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:03.100890 3268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:03.111541 3274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:03.111945 3273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:03.111910 3268 server_base.cc:1034] running on GCE node
W20260812 09:55:03.112306 3276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:03.113095 3268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:03.114387 3268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:03.115633 3268 hybrid_clock.cc:648] HybridClock initialized: now 1786528503115609 us; error 43 us; skew 500 ppm
Aug 12 09:55:03 dist-test-slave-2w3w krb5kdc[3254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528503, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:03.118842 3268 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:03.120105 3268 webserver.cc:460] Webserver started at http://127.0.0.1:41445/ using document root <none> and password file <none>
I20260812 09:55:03.120733 3268 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:03.120838 3268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:03.121143 3268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:03.123463 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "a009bbce3f4742a8adf3e47b221ea72a"
format_stamp: "Formatted at 2026-08-12 09:55:03 on dist-test-slave-2w3w"
server_key: "28e66abd3658187ad6d3f22c6eb04365"
server_key_iv: "be1c06495950fa0fa03d3d6cd217e303"
server_key_version: "encryptionkey@0"
I20260812 09:55:03.124123 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "a009bbce3f4742a8adf3e47b221ea72a"
format_stamp: "Formatted at 2026-08-12 09:55:03 on dist-test-slave-2w3w"
server_key: "28e66abd3658187ad6d3f22c6eb04365"
server_key_iv: "be1c06495950fa0fa03d3d6cd217e303"
server_key_version: "encryptionkey@0"
I20260812 09:55:03.128230 3268 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 09:55:03.131348 3283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:03.132838 3268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 09:55:03.133059 3268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "a009bbce3f4742a8adf3e47b221ea72a"
format_stamp: "Formatted at 2026-08-12 09:55:03 on dist-test-slave-2w3w"
server_key: "28e66abd3658187ad6d3f22c6eb04365"
server_key_iv: "be1c06495950fa0fa03d3d6cd217e303"
server_key_version: "encryptionkey@0"
I20260812 09:55:03.133211 3268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:03.150355 3268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:03.154479 3268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:03.154742 3268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:03.163180 3268 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39459
I20260812 09:55:03.163218 3343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39459 every 8 connection(s)
I20260812 09:55:03.164288 3268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:03.167598 3344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:03.169811 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3268
I20260812 09:55:03.169977 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:03.170300 11738 external_mini_cluster.cc:1428] Setting key 02cc40971c723250fcf9d806449a694f
I20260812 09:55:03.175822 3344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a: Bootstrap starting.
I20260812 09:55:03.178295 3344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:03.179229 3344 log.cc:824] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:03.181102 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:03.172030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:44067 (local address 127.0.0.1:39459)
0812 09:55:03.172597 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:03.172613 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:03.172663 (+ 50us) server_negotiation.cc:407] Connection header received
0812 09:55:03.173349 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:03.173367 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:03.173742 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:03.174122 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:03.174625 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:03.176184 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:03.177139 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:03.177651 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:03.177836 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:03.179045 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:03.179053 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:03.179075 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:03.179574 (+ 499us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:03.179667 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:03.179705 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:03.179856 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:03.180103 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 09:55:03.180265 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":215,"threads_started":1}
I20260812 09:55:03.181711 3344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a: No bootstrap required, opened a new log
I20260812 09:55:03.184693 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:03.186250 3344 raft_consensus.cc:348] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } }
I20260812 09:55:03.186545 3344 raft_consensus.cc:374] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:03.186656 3344 raft_consensus.cc:729] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a009bbce3f4742a8adf3e47b221ea72a, State: Initialized, Role: FOLLOWER
I20260812 09:55:03.187242 3344 consensus_queue.cc:260] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } }
I20260812 09:55:03.187475 3344 raft_consensus.cc:388] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:03.187551 3344 raft_consensus.cc:482] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:03.187664 3344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:03.188728 3344 raft_consensus.cc:504] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } }
I20260812 09:55:03.189118 3344 leader_election.cc:302] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a009bbce3f4742a8adf3e47b221ea72a; no voters:
I20260812 09:55:03.189517 3344 leader_election.cc:288] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:03.189608 3355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:03.189987 3355 raft_consensus.cc:686] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [term 1 LEADER]: Becoming Leader. State: Replica: a009bbce3f4742a8adf3e47b221ea72a, State: Running, Role: LEADER
I20260812 09:55:03.190387 3355 consensus_queue.cc:237] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } }
I20260812 09:55:03.191062 3344 sys_catalog.cc:564] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:03.191823 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:03.186995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:59349 (local address 127.0.0.1:39459)
0812 09:55:03.187120 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:03.187125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:03.187386 (+ 261us) server_negotiation.cc:407] Connection header received
0812 09:55:03.187598 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:03.187603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:03.187660 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:03.187757 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:03.188055 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:03.188616 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:03.189641 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:03.190088 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:03.190237 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:03.191253 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:03.191259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:03.191267 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:03.191282 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:03.191308 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:03.191320 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:03.191434 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:03.191620 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 09:55:03.191660 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":39}
I20260812 09:55:03.192303 3357 sys_catalog.cc:455] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a009bbce3f4742a8adf3e47b221ea72a. Latest consensus state: current_term: 1 leader_uuid: "a009bbce3f4742a8adf3e47b221ea72a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } } }
I20260812 09:55:03.192457 3357 sys_catalog.cc:458] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:03.192647 3356 sys_catalog.cc:455] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a009bbce3f4742a8adf3e47b221ea72a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a009bbce3f4742a8adf3e47b221ea72a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39459 } } }
I20260812 09:55:03.192848 3356 sys_catalog.cc:458] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:03.193459 3366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:03.196913 3366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:03.204348 3366 catalog_manager.cc:1347] Generated new cluster ID: 05fde6c8ecd84a94a8e6044e4e2c7e55
I20260812 09:55:03.204553 3366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:03.240991 3366 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:03.242283 3366 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:03.260834 3366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a009bbce3f4742a8adf3e47b221ea72a: Generated new TSK 0
I20260812 09:55:03.261873 3366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:03.280642 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3268
W20260812 09:55:03.289781 3251 connection.cc:535] client connection to 127.0.0.1:39459 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39459): Connection reset by peer (error 104)
2026-08-12T09:55:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1638 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:03 dist-test-slave-2w3w krb5kdc[3378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:03 dist-test-slave-2w3w krb5kdc[3378](info): set up 2 sockets
Aug 12 09:55:03 dist-test-slave-2w3w krb5kdc[3378](info): commencing operation
krb5kdc: starting...
W20260812 09:55:04.425400 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:04 dist-test-slave-2w3w krb5kdc[3378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:04.579995 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:04.700562 3394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:04.700958 3394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:04.701054 3394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:04.705436 3394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:04.705543 3394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:04.705583 3394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:04.705643 3394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:04.705681 3394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:04.711501 3394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:04.712857 3394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:04.713954 3394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:04.723340 3399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:04.723485 3394 server_base.cc:1034] running on GCE node
W20260812 09:55:04.723340 3400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:04.723384 3402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:04.724418 3394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:04.725616 3394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:04.726805 3394 hybrid_clock.cc:648] HybridClock initialized: now 1786528504726777 us; error 44 us; skew 500 ppm
Aug 12 09:55:04 dist-test-slave-2w3w krb5kdc[3378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528504, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:04.729954 3394 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:04.730945 3394 webserver.cc:460] Webserver started at http://127.0.0.1:40869/ using document root <none> and password file <none>
I20260812 09:55:04.731739 3394 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:04.731897 3394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:04.732297 3394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:04.735034 3394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "4805811c31b441cd81ceefa80d115615"
format_stamp: "Formatted at 2026-08-12 09:55:04 on dist-test-slave-2w3w"
server_key: "b616277a0fad1f85d9efb939b9ec2f9b"
server_key_iv: "d1d983a66f0ed8a18ec9845859de2ced"
server_key_version: "encryptionkey@0"
I20260812 09:55:04.735849 3394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "4805811c31b441cd81ceefa80d115615"
format_stamp: "Formatted at 2026-08-12 09:55:04 on dist-test-slave-2w3w"
server_key: "b616277a0fad1f85d9efb939b9ec2f9b"
server_key_iv: "d1d983a66f0ed8a18ec9845859de2ced"
server_key_version: "encryptionkey@0"
I20260812 09:55:04.740545 3394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260812 09:55:04.744047 3414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:04.745852 3394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:55:04.746066 3394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "4805811c31b441cd81ceefa80d115615"
format_stamp: "Formatted at 2026-08-12 09:55:04 on dist-test-slave-2w3w"
server_key: "b616277a0fad1f85d9efb939b9ec2f9b"
server_key_iv: "d1d983a66f0ed8a18ec9845859de2ced"
server_key_version: "encryptionkey@0"
I20260812 09:55:04.746232 3394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:04.751873 3394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:04.755904 3394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:04.756148 3394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:04.764804 3394 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35345
I20260812 09:55:04.764818 3477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35345 every 8 connection(s)
I20260812 09:55:04.765856 3394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:04.768905 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3394
I20260812 09:55:04.769079 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:04.769246 3478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:04.769459 11738 external_mini_cluster.cc:1428] Setting key 9c3c0d50258735aff3c5931393c605b1
I20260812 09:55:04.775285 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:04.770993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:33023 (local address 127.0.0.1:35345)
0812 09:55:04.771499 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:04.771516 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:04.771556 (+ 40us) server_negotiation.cc:407] Connection header received
0812 09:55:04.772356 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:04.772378 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:04.772685 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:04.773050 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:04.773933 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:04.773938 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:04.773950 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:04.773961 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:04.774018 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:04.774037 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:04.774201 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:04.774275 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 09:55:04.774449 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":159,"threads_started":1}
I20260812 09:55:04.776942 3478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615: Bootstrap starting.
I20260812 09:55:04.778565 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:04.779776 3478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:04.780647 3478 log.cc:824] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:04.783169 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:04.780914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:52357 (local address 127.0.0.1:35345)
0812 09:55:04.781069 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:04.781077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:04.781271 (+ 194us) server_negotiation.cc:407] Connection header received
0812 09:55:04.781367 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:04.781370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:04.781414 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:04.781518 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:04.782479 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:04.782482 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:04.782484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:04.782496 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:04.782525 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:04.782537 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:04.782622 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:04.782803 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 09:55:04.782996 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:55:04.783546 3478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615: No bootstrap required, opened a new log
I20260812 09:55:04.787482 3478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } }
I20260812 09:55:04.787788 3478 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:04.787858 3478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4805811c31b441cd81ceefa80d115615, State: Initialized, Role: FOLLOWER
I20260812 09:55:04.788306 3478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } }
I20260812 09:55:04.788470 3478 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:04.788564 3478 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:04.788690 3478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:04.789826 3478 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } }
I20260812 09:55:04.790233 3478 leader_election.cc:302] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4805811c31b441cd81ceefa80d115615; no voters:
I20260812 09:55:04.790622 3478 leader_election.cc:288] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:04.790903 3491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:04.791445 3491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [term 1 LEADER]: Becoming Leader. State: Replica: 4805811c31b441cd81ceefa80d115615, State: Running, Role: LEADER
I20260812 09:55:04.791857 3491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } }
I20260812 09:55:04.792057 3478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:04.793758 3493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4805811c31b441cd81ceefa80d115615. Latest consensus state: current_term: 1 leader_uuid: "4805811c31b441cd81ceefa80d115615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } } }
I20260812 09:55:04.793921 3493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:04.794266 3506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:04.793759 3492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4805811c31b441cd81ceefa80d115615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4805811c31b441cd81ceefa80d115615" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35345 } } }
I20260812 09:55:04.794715 3492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:04.797755 3506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:04.804615 3506 catalog_manager.cc:1347] Generated new cluster ID: f107f7d3ab5c48f881c090da173bc266
I20260812 09:55:04.804715 3506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:04.837036 3506 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:04.837904 3506 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:04.845002 3506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4805811c31b441cd81ceefa80d115615: Generated new TSK 0
I20260812 09:55:04.846031 3506 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:04.858134 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3394
2026-08-12T09:55:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1579 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:04 dist-test-slave-2w3w krb5kdc[3515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:04 dist-test-slave-2w3w krb5kdc[3515](info): set up 2 sockets
Aug 12 09:55:04 dist-test-slave-2w3w krb5kdc[3515](info): commencing operation
krb5kdc: starting...
W20260812 09:55:06.027478 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:06.175767 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:06.293365 3529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:06.293677 3529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:06.293722 3529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:06.298125 3529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:06.298223 3529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:06.298243 3529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:06.298266 3529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:06.298282 3529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:06.304327 3529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:06.305568 3529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:06.306674 3529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:06.315949 3540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:06.315949 3537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:06.315924 3534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:06.316485 3529 server_base.cc:1034] running on GCE node
I20260812 09:55:06.317102 3529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:06.318465 3529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:06.319674 3529 hybrid_clock.cc:648] HybridClock initialized: now 1786528506319656 us; error 35 us; skew 500 ppm
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528506, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:06.330786 3529 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:06.332067 3529 webserver.cc:460] Webserver started at http://127.0.0.1:36453/ using document root <none> and password file <none>
I20260812 09:55:06.332752 3529 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:06.332844 3529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:06.333101 3529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:06.335973 3529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "220ab47d5b034c8c8d7b4d2d91c87571"
format_stamp: "Formatted at 2026-08-12 09:55:06 on dist-test-slave-2w3w"
server_key: "0cc5caced6a95b81cd9a1ebec32b2eac"
server_key_iv: "70c0496bce5d971e3b5b85747c365236"
server_key_version: "encryptionkey@0"
I20260812 09:55:06.336668 3529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "220ab47d5b034c8c8d7b4d2d91c87571"
format_stamp: "Formatted at 2026-08-12 09:55:06 on dist-test-slave-2w3w"
server_key: "0cc5caced6a95b81cd9a1ebec32b2eac"
server_key_iv: "70c0496bce5d971e3b5b85747c365236"
server_key_version: "encryptionkey@0"
I20260812 09:55:06.341112 3529 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260812 09:55:06.344376 3548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:06.345928 3529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:55:06.346100 3529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "220ab47d5b034c8c8d7b4d2d91c87571"
format_stamp: "Formatted at 2026-08-12 09:55:06 on dist-test-slave-2w3w"
server_key: "0cc5caced6a95b81cd9a1ebec32b2eac"
server_key_iv: "70c0496bce5d971e3b5b85747c365236"
server_key_version: "encryptionkey@0"
I20260812 09:55:06.346256 3529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:06.366868 3529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:06.370609 3529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:06.370857 3529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:06.379611 3529 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46213
I20260812 09:55:06.379671 3610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46213 every 8 connection(s)
I20260812 09:55:06.380774 3529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:06.384833 3612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:06.385231 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3529
I20260812 09:55:06.385391 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:06.385697 11738 external_mini_cluster.cc:1428] Setting key 26efe0e4fc8371abe7b03494e9010486
I20260812 09:55:06.392572 3612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571: Bootstrap starting.
I20260812 09:55:06.395438 3612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:06.396246 3612 log.cc:824] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 09:55:06.398428 3612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571: No bootstrap required, opened a new log
I20260812 09:55:06.402487 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:06.387357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:49529 (local address 127.0.0.1:46213)
0812 09:55:06.387875 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:06.387896 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:06.388056 (+ 160us) server_negotiation.cc:407] Connection header received
0812 09:55:06.388969 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:06.388994 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:06.389498 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:06.389884 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:06.390680 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:06.392288 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:06.393404 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:06.394163 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:06.394362 (+ 199us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:06.397308 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:06.397314 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:06.397330 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:06.397362 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:06.399335 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:06.399943 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:06.399949 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:06.399954 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:06.400073 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:06.400445 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:06.400449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:06.400451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:06.400874 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:06.401114 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:06.401454 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 09:55:06.401693 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":135,"threads_started":1}
I20260812 09:55:06.402578 3612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } }
I20260812 09:55:06.402901 3612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:06.403012 3612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220ab47d5b034c8c8d7b4d2d91c87571, State: Initialized, Role: FOLLOWER
I20260812 09:55:06.403515 3612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } }
I20260812 09:55:06.403674 3612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:06.403750 3612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:06.403851 3612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:06.405112 3612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } }
I20260812 09:55:06.405480 3612 leader_election.cc:302] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 220ab47d5b034c8c8d7b4d2d91c87571; no voters:
I20260812 09:55:06.405884 3612 leader_election.cc:288] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:06.405952 3617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:06.405987 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:06.406165 3617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [term 1 LEADER]: Becoming Leader. State: Replica: 220ab47d5b034c8c8d7b4d2d91c87571, State: Running, Role: LEADER
I20260812 09:55:06.406544 3617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } }
I20260812 09:55:06.407301 3612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:06.408407 3618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 220ab47d5b034c8c8d7b4d2d91c87571. Latest consensus state: current_term: 1 leader_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } } }
I20260812 09:55:06.408568 3618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:06.409317 3619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220ab47d5b034c8c8d7b4d2d91c87571" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46213 } } }
I20260812 09:55:06.409440 3619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:06.409564 3632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:06.413229 3632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:06.419057 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:06.409072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:33589 (local address 127.0.0.1:46213)
0812 09:55:06.409194 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:06.409199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:06.409223 (+ 24us) server_negotiation.cc:407] Connection header received
0812 09:55:06.409586 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:06.409591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:06.409657 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:06.409717 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:06.410830 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:06.411649 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:06.412815 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:06.413196 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:06.413310 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:06.415163 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:06.415167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:06.415170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:06.415199 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:06.417044 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:06.417588 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:06.417591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:06.417593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:06.417684 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:06.418048 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:06.418052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:06.418053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:06.418303 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:06.418452 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:06.418726 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 09:55:06.418842 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 09:55:06.423907 3632 catalog_manager.cc:1347] Generated new cluster ID: a051f593e3254168ab498d52614f7848
I20260812 09:55:06.424039 3632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:06.435343 3632 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:06.436481 3632 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:06.444661 3632 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 220ab47d5b034c8c8d7b4d2d91c87571: Generated new TSK 0
I20260812 09:55:06.445601 3632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:06.458786 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3529
W20260812 09:55:06.467947 3513 connection.cc:535] client connection to 127.0.0.1:46213 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46213): Connection reset by peer (error 104)
2026-08-12T09:55:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3647](info): set up 2 sockets
Aug 12 09:55:06 dist-test-slave-2w3w krb5kdc[3647](info): commencing operation
krb5kdc: starting...
W20260812 09:55:07.605123 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:07 dist-test-slave-2w3w krb5kdc[3647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:07.756570 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40757
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:07.882244 3663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:07.882643 3663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:07.882745 3663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:07.887570 3663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:07.887714 3663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:07.887761 3663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:07.887802 3663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:07.887844 3663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:07.894227 3663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40757
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:07.895557 3663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:07.896724 3663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:07.906888 3674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:07.907013 3663 server_base.cc:1034] running on GCE node
W20260812 09:55:07.906932 3670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:07.906944 3669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:07.907801 3663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:07.909163 3663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:07.912552 3663 hybrid_clock.cc:648] HybridClock initialized: now 1786528507912476 us; error 111 us; skew 500 ppm
Aug 12 09:55:07 dist-test-slave-2w3w krb5kdc[3647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528507, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:07.916785 3663 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:07.918677 3663 webserver.cc:460] Webserver started at http://127.0.0.1:33677/ using document root <none> and password file <none>
I20260812 09:55:07.919468 3663 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:07.919587 3663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:07.919866 3663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:07.922257 3663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "c2292e73ea4d497eb6924d0c835d2f96"
format_stamp: "Formatted at 2026-08-12 09:55:07 on dist-test-slave-2w3w"
server_key: "4cd9641ff4825c88d264ff9b76bb5d31"
server_key_iv: "f4ba5f9ff22200eaa2718f790732abd0"
server_key_version: "encryptionkey@0"
I20260812 09:55:07.923091 3663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "c2292e73ea4d497eb6924d0c835d2f96"
format_stamp: "Formatted at 2026-08-12 09:55:07 on dist-test-slave-2w3w"
server_key: "4cd9641ff4825c88d264ff9b76bb5d31"
server_key_iv: "f4ba5f9ff22200eaa2718f790732abd0"
server_key_version: "encryptionkey@0"
I20260812 09:55:07.928354 3663 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 09:55:07.931595 3684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:07.933284 3663 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 09:55:07.933531 3663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "c2292e73ea4d497eb6924d0c835d2f96"
format_stamp: "Formatted at 2026-08-12 09:55:07 on dist-test-slave-2w3w"
server_key: "4cd9641ff4825c88d264ff9b76bb5d31"
server_key_iv: "f4ba5f9ff22200eaa2718f790732abd0"
server_key_version: "encryptionkey@0"
I20260812 09:55:07.933705 3663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:07.966337 3663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:07.969976 3663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:07.970223 3663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:07.979065 3663 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40757
I20260812 09:55:07.979176 3743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40757 every 8 connection(s)
I20260812 09:55:07.980211 3663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:07.983640 3744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:07.986436 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3663
I20260812 09:55:07.986622 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:07.987012 11738 external_mini_cluster.cc:1428] Setting key 66f34e35dea876a2f84ed5b15c91771b
I20260812 09:55:07.990093 3744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96: Bootstrap starting.
I20260812 09:55:07.993136 3744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:07.994086 3744 log.cc:824] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:07.996304 3744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96: No bootstrap required, opened a new log
I20260812 09:55:07.997568 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:07.988484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:59389 (local address 127.0.0.1:40757)
0812 09:55:07.988964 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:07.988980 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:07.989019 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:55:07.989690 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:07.989719 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:07.990100 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:07.990468 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:07.990860 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:07.991998 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:07.993344 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:07.993942 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:07.994356 (+ 414us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:07.995446 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:07.995453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:07.995470 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:07.995907 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:07.996000 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:07.996027 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:07.996185 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:07.996386 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 09:55:07.996568 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":163,"threads_started":1}
I20260812 09:55:08.000682 3744 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } }
I20260812 09:55:08.001013 3744 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:08.001113 3744 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2292e73ea4d497eb6924d0c835d2f96, State: Initialized, Role: FOLLOWER
I20260812 09:55:08.002130 3744 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } }
I20260812 09:55:08.002507 3744 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:08.002839 3744 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:08.003098 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:08.003105 3744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:08.004243 3744 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } }
I20260812 09:55:08.004696 3744 leader_election.cc:302] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2292e73ea4d497eb6924d0c835d2f96; no voters:
I20260812 09:55:08.005142 3744 leader_election.cc:288] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:08.005239 3756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:08.005507 3756 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [term 1 LEADER]: Becoming Leader. State: Replica: c2292e73ea4d497eb6924d0c835d2f96, State: Running, Role: LEADER
I20260812 09:55:08.005908 3756 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } }
I20260812 09:55:08.006876 3744 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:08.008020 3758 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2292e73ea4d497eb6924d0c835d2f96. Latest consensus state: current_term: 1 leader_uuid: "c2292e73ea4d497eb6924d0c835d2f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } } }
I20260812 09:55:08.008178 3758 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:08.008515 3757 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2292e73ea4d497eb6924d0c835d2f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2292e73ea4d497eb6924d0c835d2f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40757 } } }
I20260812 09:55:08.008620 3757 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:08.009080 3767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:08.011899 3748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:08.005800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:37161 (local address 127.0.0.1:40757)
0812 09:55:08.005945 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:08.005950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:08.006535 (+ 585us) server_negotiation.cc:407] Connection header received
0812 09:55:08.006721 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:08.006726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:08.006784 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:08.006872 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:08.007221 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:08.008163 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:08.009754 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:08.010130 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:08.010268 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:08.011353 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:08.011357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:08.011361 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:08.011378 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:08.011416 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:08.011429 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:08.011544 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:08.011679 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 09:55:08.011719 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 09:55:08.012712 3767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:08.019611 3767 catalog_manager.cc:1347] Generated new cluster ID: 9500dbd8495f4e7691c87939702315f1
I20260812 09:55:08.019717 3767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:08.032944 3767 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:08.034317 3767 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:08.048527 3767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2292e73ea4d497eb6924d0c835d2f96: Generated new TSK 0
I20260812 09:55:08.049474 3767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:08.055115 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3663
W20260812 09:55:08.064275 3645 connection.cc:535] client connection to 127.0.0.1:40757 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40757): Connection reset by peer (error 104)
2026-08-12T09:55:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:08 dist-test-slave-2w3w krb5kdc[3781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:08 dist-test-slave-2w3w krb5kdc[3781](info): set up 2 sockets
Aug 12 09:55:08 dist-test-slave-2w3w krb5kdc[3781](info): commencing operation
krb5kdc: starting...
W20260812 09:55:09.214108 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:09 dist-test-slave-2w3w krb5kdc[3781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528509, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 09:55:09.364949 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37515
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:09.486094 3796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:09.486459 3796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:09.486546 3796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:09.490794 3796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:09.490934 3796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:09.490978 3796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:09.491042 3796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:09.491079 3796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:09.497025 3796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37515
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:09.498273 3796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:09.499408 3796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:55:09.509392 3796 server_base.cc:1034] running on GCE node
W20260812 09:55:09.509292 3804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:09.509413 3802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:09.509316 3801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:09.510275 3796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:09.511665 3796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:09.512883 3796 hybrid_clock.cc:648] HybridClock initialized: now 1786528509512850 us; error 48 us; skew 500 ppm
Aug 12 09:55:09 dist-test-slave-2w3w krb5kdc[3781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528509, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:09.516286 3796 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 09:55:09.517308 3796 webserver.cc:460] Webserver started at http://127.0.0.1:37287/ using document root <none> and password file <none>
I20260812 09:55:09.517958 3796 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:09.518064 3796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:09.518322 3796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:09.520670 3796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "bbc4b62e7a894f1bbb81cac62d10af09"
format_stamp: "Formatted at 2026-08-12 09:55:09 on dist-test-slave-2w3w"
server_key: "2e8dea0ff55b464634ee5edac44a2403"
server_key_iv: "936e0b6f6cc04735df239d6a199250bc"
server_key_version: "encryptionkey@0"
I20260812 09:55:09.521328 3796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "bbc4b62e7a894f1bbb81cac62d10af09"
format_stamp: "Formatted at 2026-08-12 09:55:09 on dist-test-slave-2w3w"
server_key: "2e8dea0ff55b464634ee5edac44a2403"
server_key_iv: "936e0b6f6cc04735df239d6a199250bc"
server_key_version: "encryptionkey@0"
I20260812 09:55:09.525821 3796 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 09:55:09.528820 3812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:09.530210 3796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:55:09.530412 3796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "bbc4b62e7a894f1bbb81cac62d10af09"
format_stamp: "Formatted at 2026-08-12 09:55:09 on dist-test-slave-2w3w"
server_key: "2e8dea0ff55b464634ee5edac44a2403"
server_key_iv: "936e0b6f6cc04735df239d6a199250bc"
server_key_version: "encryptionkey@0"
I20260812 09:55:09.530558 3796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:09.535830 3796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:09.539409 3796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:09.539651 3796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:09.548470 3796 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37515
I20260812 09:55:09.548506 3874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37515 every 8 connection(s)
I20260812 09:55:09.549551 3796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:09.552699 3875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:09.553444 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3796
I20260812 09:55:09.553632 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:09.553941 11738 external_mini_cluster.cc:1428] Setting key 04a7c025df716c6c1ec474f0ee600e29
I20260812 09:55:09.560516 3875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09: Bootstrap starting.
I20260812 09:55:09.560561 3878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:09.555517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:42859 (local address 127.0.0.1:37515)
0812 09:55:09.556012 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:09.556034 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:09.556086 (+ 52us) server_negotiation.cc:407] Connection header received
0812 09:55:09.556991 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:09.557015 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:09.557442 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:09.557845 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:09.558899 (+ 1054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:09.558907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:09.558925 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:09.558940 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:09.559046 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:09.559084 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:09.559259 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:09.559405 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 09:55:09.559588 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":136,"threads_started":1}
I20260812 09:55:09.563409 3875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:09.564031 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:09.564359 3875 log.cc:824] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:09.566730 3875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09: No bootstrap required, opened a new log
I20260812 09:55:09.568307 3878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:09.566384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.84:52609 (local address 127.0.0.1:37515)
0812 09:55:09.566533 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:09.566538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:09.566698 (+ 160us) server_negotiation.cc:407] Connection header received
0812 09:55:09.566827 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:09.566831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:09.566870 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:09.566975 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:09.567889 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:09.567893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:09.567896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:09.567908 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:09.567941 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:09.567956 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:09.568055 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:09.568116 (+ 61us) server_negotiation.cc:299] Negotiation successful
0812 09:55:09.568162 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 09:55:09.570842 3875 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } }
I20260812 09:55:09.571174 3875 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:09.571249 3875 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbc4b62e7a894f1bbb81cac62d10af09, State: Initialized, Role: FOLLOWER
I20260812 09:55:09.571702 3875 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } }
I20260812 09:55:09.571879 3875 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:09.571971 3875 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:09.572103 3875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:09.573189 3875 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } }
I20260812 09:55:09.573575 3875 leader_election.cc:302] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbc4b62e7a894f1bbb81cac62d10af09; no voters:
I20260812 09:55:09.573935 3875 leader_election.cc:288] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:09.574120 3886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:09.574476 3886 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [term 1 LEADER]: Becoming Leader. State: Replica: bbc4b62e7a894f1bbb81cac62d10af09, State: Running, Role: LEADER
I20260812 09:55:09.574833 3886 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } }
I20260812 09:55:09.575383 3875 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:09.576792 3889 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbc4b62e7a894f1bbb81cac62d10af09. Latest consensus state: current_term: 1 leader_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } } }
I20260812 09:55:09.576792 3888 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbc4b62e7a894f1bbb81cac62d10af09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37515 } } }
I20260812 09:55:09.577024 3888 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:09.577215 3889 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:09.577581 3898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:09.581058 3898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:09.587653 3898 catalog_manager.cc:1347] Generated new cluster ID: 4e2599e7ee7545babe090ae7ec37a109
I20260812 09:55:09.587808 3898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:09.619508 3898 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:09.619971 3898 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:09.626513 3898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbc4b62e7a894f1bbb81cac62d10af09: Generated new TSK 0
I20260812 09:55:09.627470 3898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:09.630540 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3796
2026-08-12T09:55:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:09 dist-test-slave-2w3w krb5kdc[3910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:09 dist-test-slave-2w3w krb5kdc[3910](info): set up 2 sockets
Aug 12 09:55:09 dist-test-slave-2w3w krb5kdc[3910](info): commencing operation
krb5kdc: starting...
W20260812 09:55:10.773042 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:10 dist-test-slave-2w3w krb5kdc[3910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:10.923357 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40801
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:38507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:11.050693 3925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:11.051185 3925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:11.051270 3925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:11.055656 3925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:11.055756 3925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:11.055794 3925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:11.055830 3925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:11.055871 3925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:11.061923 3925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40801
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:11.063275 3925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:11.064401 3925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:11.074155 3931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:11.074182 3933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:11.074237 3930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:11.074702 3925 server_base.cc:1034] running on GCE node
I20260812 09:55:11.075591 3925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:11.076864 3925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:11.078038 3925 hybrid_clock.cc:648] HybridClock initialized: now 1786528511078020 us; error 35 us; skew 500 ppm
Aug 12 09:55:11 dist-test-slave-2w3w krb5kdc[3910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528511, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:11.081192 3925 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:11.082228 3925 webserver.cc:460] Webserver started at http://127.11.118.190:44193/ using document root <none> and password file <none>
I20260812 09:55:11.082839 3925 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:11.082945 3925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:11.083210 3925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:11.085407 3925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "80d268b110bd4d81a29de619fc920b69"
format_stamp: "Formatted at 2026-08-12 09:55:11 on dist-test-slave-2w3w"
server_key: "0f3d534109111be60760b1606fc18f42"
server_key_iv: "c9a618003bc23cfaa068519d4b2f5554"
server_key_version: "encryptionkey@0"
I20260812 09:55:11.085996 3925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "80d268b110bd4d81a29de619fc920b69"
format_stamp: "Formatted at 2026-08-12 09:55:11 on dist-test-slave-2w3w"
server_key: "0f3d534109111be60760b1606fc18f42"
server_key_iv: "c9a618003bc23cfaa068519d4b2f5554"
server_key_version: "encryptionkey@0"
I20260812 09:55:11.090062 3925 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260812 09:55:11.092738 3940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:11.094269 3925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:55:11.094429 3925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "80d268b110bd4d81a29de619fc920b69"
format_stamp: "Formatted at 2026-08-12 09:55:11 on dist-test-slave-2w3w"
server_key: "0f3d534109111be60760b1606fc18f42"
server_key_iv: "c9a618003bc23cfaa068519d4b2f5554"
server_key_version: "encryptionkey@0"
I20260812 09:55:11.094563 3925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:11.109477 3925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:11.113162 3925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:11.113396 3925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:11.121657 3925 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:40801
I20260812 09:55:11.121673 4003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:40801 every 8 connection(s)
I20260812 09:55:11.122747 3925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:11.125808 4004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:11.132246 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 3925
I20260812 09:55:11.132400 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:11.132438 4004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: Bootstrap starting.
I20260812 09:55:11.132725 11738 external_mini_cluster.cc:1428] Setting key 2517796b233b31cc2d4a9b4a45eba568
I20260812 09:55:11.135425 4004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:11.136298 4004 log.cc:824] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:11.139202 4004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: No bootstrap required, opened a new log
Aug 12 09:55:11 dist-test-slave-2w3w krb5kdc[3910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:11.144140 4004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } }
I20260812 09:55:11.144440 4004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:11.144527 4004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80d268b110bd4d81a29de619fc920b69, State: Initialized, Role: FOLLOWER
I20260812 09:55:11.145174 4004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } }
I20260812 09:55:11.145385 4004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:11.145462 4004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:11.145576 4004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:11.146939 4004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } }
I20260812 09:55:11.147430 4004 leader_election.cc:302] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80d268b110bd4d81a29de619fc920b69; no voters:
I20260812 09:55:11.147845 4004 leader_election.cc:288] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:11.148025 4010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:11.148310 4010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [term 1 LEADER]: Becoming Leader. State: Replica: 80d268b110bd4d81a29de619fc920b69, State: Running, Role: LEADER
I20260812 09:55:11.148707 4010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } }
I20260812 09:55:11.149358 4004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:11.150806 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:11.134198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51417 (local address 127.11.118.190:40801)
0812 09:55:11.134641 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:11.134658 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:11.134696 (+ 38us) server_negotiation.cc:407] Connection header received
0812 09:55:11.135492 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:11.135513 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:11.135941 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:11.136243 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:11.137295 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:11.138596 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:11.139901 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:11.140475 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:11.140624 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:11.143941 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:11.143948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:11.143966 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:11.144005 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:11.146381 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:11.147111 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:11.147118 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:11.147125 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:11.147299 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:11.147774 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:11.147780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:11.147784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:11.148415 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:11.148646 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:11.149400 (+ 754us) server_negotiation.cc:299] Negotiation successful
0812 09:55:11.149661 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":139,"threads_started":1}
I20260812 09:55:11.150758 4012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80d268b110bd4d81a29de619fc920b69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } } }
I20260812 09:55:11.150882 4012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:11.150720 4011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80d268b110bd4d81a29de619fc920b69. Latest consensus state: current_term: 1 leader_uuid: "80d268b110bd4d81a29de619fc920b69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80d268b110bd4d81a29de619fc920b69" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40801 } } }
I20260812 09:55:11.151193 4011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:11.154533 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 09:55:11.154804 4026 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:11.154893 4026 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:11.155001 4019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:11.155872 4019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:11.161749 4019 catalog_manager.cc:1347] Generated new cluster ID: 59a72dffb1f840fb836f62d665355dfe
I20260812 09:55:11.161867 4019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:11.170183 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:11.159998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49901 (local address 127.11.118.190:40801)
0812 09:55:11.160114 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:11.160119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:11.162286 (+ 2167us) server_negotiation.cc:407] Connection header received
0812 09:55:11.162463 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:11.162467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:11.162518 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:11.162606 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:11.163443 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:11.163995 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:11.164830 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:11.165085 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:11.165197 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:11.166724 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:11.166733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:11.166736 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:11.166762 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:11.168287 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:11.168817 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:11.168823 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:11.168829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:11.168925 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:11.169269 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:11.169272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:11.169274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:11.169461 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:11.169626 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:11.169911 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 09:55:11.170011 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 09:55:11.185233 4019 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:11.186316 4019 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:11.191725 4019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80d268b110bd4d81a29de619fc920b69: Generated new TSK 0
I20260812 09:55:11.192482 4019 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:11.200387 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 3925
W20260812 09:55:11.210036 3908 connection.cc:535] client connection to 127.11.118.190:40801 recv error: Network error: failed to read from TLS socket (remote: 127.11.118.190:40801): Connection reset by peer (error 104)
2026-08-12T09:55:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:11 dist-test-slave-2w3w krb5kdc[4038](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:11 dist-test-slave-2w3w krb5kdc[4038](info): set up 2 sockets
Aug 12 09:55:11 dist-test-slave-2w3w krb5kdc[4038](info): commencing operation
krb5kdc: starting...
W20260812 09:55:12.328310 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:12 dist-test-slave-2w3w krb5kdc[4038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:12.477298 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42581
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:42581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:12.600011 4054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:12.600383 4054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:12.600463 4054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:12.604808 4054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:12.604919 4054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:12.604959 4054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:12.605000 4054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:12.605041 4054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:12.610750 4054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:42581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:42581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:12.612030 4054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:12.613130 4054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:12.622293 4065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:12.622354 4054 server_base.cc:1034] running on GCE node
W20260812 09:55:12.622316 4063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:12.622287 4061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:12.623317 4054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:12.624611 4054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:12.625862 4054 hybrid_clock.cc:648] HybridClock initialized: now 1786528512625834 us; error 56 us; skew 500 ppm
Aug 12 09:55:12 dist-test-slave-2w3w krb5kdc[4038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528512, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:12.633575 4054 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:12.634887 4054 webserver.cc:460] Webserver started at http://127.11.118.190:40693/ using document root <none> and password file <none>
I20260812 09:55:12.635571 4054 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:12.635679 4054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:12.635915 4054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:12.638195 4054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "b1f8adaf0076468db573c9d0a2f3a9fc"
format_stamp: "Formatted at 2026-08-12 09:55:12 on dist-test-slave-2w3w"
server_key: "2e0c566ee1a4e9d3d2dd5ca9e45f685b"
server_key_iv: "d1c8c49ab3d1398c8185906951d31f70"
server_key_version: "encryptionkey@0"
I20260812 09:55:12.638836 4054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "b1f8adaf0076468db573c9d0a2f3a9fc"
format_stamp: "Formatted at 2026-08-12 09:55:12 on dist-test-slave-2w3w"
server_key: "2e0c566ee1a4e9d3d2dd5ca9e45f685b"
server_key_iv: "d1c8c49ab3d1398c8185906951d31f70"
server_key_version: "encryptionkey@0"
I20260812 09:55:12.643096 4054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 09:55:12.646250 4072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:12.647703 4054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 09:55:12.647902 4054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "b1f8adaf0076468db573c9d0a2f3a9fc"
format_stamp: "Formatted at 2026-08-12 09:55:12 on dist-test-slave-2w3w"
server_key: "2e0c566ee1a4e9d3d2dd5ca9e45f685b"
server_key_iv: "d1c8c49ab3d1398c8185906951d31f70"
server_key_version: "encryptionkey@0"
I20260812 09:55:12.648043 4054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:12.665576 4054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:12.670655 4054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:12.670950 4054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:12.679965 4054 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:42581
I20260812 09:55:12.680202 4135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:42581 every 8 connection(s)
I20260812 09:55:12.681205 4054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:12.684670 4136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:12.687081 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4054
I20260812 09:55:12.687248 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:12.687551 11738 external_mini_cluster.cc:1428] Setting key 04267c44cb8ec3f9f8f77683ce754271
I20260812 09:55:12.692149 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: Bootstrap starting.
I20260812 09:55:12.694774 4136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:12.695739 4136 log.cc:824] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:12.698477 4136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: No bootstrap required, opened a new log
I20260812 09:55:12.698800 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:12.689694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40909 (local address 127.11.118.190:42581)
0812 09:55:12.690298 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:12.690315 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:12.690357 (+ 42us) server_negotiation.cc:407] Connection header received
0812 09:55:12.691166 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:12.691188 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:12.691610 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:12.692014 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:12.692474 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:12.693508 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:12.694489 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:12.695133 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:12.695327 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:12.696435 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:12.696445 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:12.696460 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:12.697082 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:12.697155 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:12.697187 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:12.697341 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:12.697596 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 09:55:12.697741 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":171,"threads_started":1}
I20260812 09:55:12.702518 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:12.703220 4136 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } }
I20260812 09:55:12.703567 4136 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:12.703624 4136 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f8adaf0076468db573c9d0a2f3a9fc, State: Initialized, Role: FOLLOWER
I20260812 09:55:12.704171 4136 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } }
I20260812 09:55:12.704381 4136 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:12.704450 4136 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:12.704564 4136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:12.706004 4136 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } }
I20260812 09:55:12.706434 4136 leader_election.cc:302] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1f8adaf0076468db573c9d0a2f3a9fc; no voters:
I20260812 09:55:12.706818 4136 leader_election.cc:288] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:12.707113 4149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:12.707404 4149 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [term 1 LEADER]: Becoming Leader. State: Replica: b1f8adaf0076468db573c9d0a2f3a9fc, State: Running, Role: LEADER
I20260812 09:55:12.707777 4149 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } }
I20260812 09:55:12.708632 4136 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:12.709197 4149 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f8adaf0076468db573c9d0a2f3a9fc. Latest consensus state: current_term: 1 leader_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } } }
I20260812 09:55:12.709394 4149 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:12.709668 4151 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f8adaf0076468db573c9d0a2f3a9fc" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 42581 } } }
I20260812 09:55:12.709776 4151 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:12.711440 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:12.705162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44321 (local address 127.11.118.190:42581)
0812 09:55:12.705306 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:12.705310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:12.705498 (+ 188us) server_negotiation.cc:407] Connection header received
0812 09:55:12.705637 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:12.705640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:12.705693 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:12.705808 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:12.706435 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:12.707316 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:12.708697 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:12.709096 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:12.710300 (+ 1204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:12.710484 (+ 184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:12.710488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:12.710490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:12.710506 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:12.710535 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:12.710551 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:12.710724 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:12.711147 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 09:55:12.711191 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 09:55:12.714344 4165 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:12.714450 4165 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:12.714564 4154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:12.715569 4154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:12.722026 4154 catalog_manager.cc:1347] Generated new cluster ID: a5fa053aec0347abb772a1f99ccc18b3
I20260812 09:55:12.722185 4154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:12.731217 4154 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:12.732616 4154 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:12.744526 4154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1f8adaf0076468db573c9d0a2f3a9fc: Generated new TSK 0
I20260812 09:55:12.745666 4154 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:12.760031 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4054
W20260812 09:55:12.770145 4036 connection.cc:535] client connection to 127.11.118.190:42581 recv error: Network error: failed to read from TLS socket (remote: 127.11.118.190:42581): Connection reset by peer (error 104)
2026-08-12T09:55:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1560 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:12 dist-test-slave-2w3w krb5kdc[4172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:12 dist-test-slave-2w3w krb5kdc[4172](info): set up 2 sockets
Aug 12 09:55:12 dist-test-slave-2w3w krb5kdc[4172](info): commencing operation
krb5kdc: starting...
W20260812 09:55:13.910097 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:14 dist-test-slave-2w3w krb5kdc[4172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:14.062542 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40279
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:38085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:14.189054 4187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:14.189429 4187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:14.189512 4187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:14.193745 4187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:14.193872 4187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:14.193912 4187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:14.193982 4187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:14.194021 4187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:14.199831 4187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:38085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:14.201094 4187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:14.202144 4187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:14.211634 4195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:14.211632 4194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:14.211652 4197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:14.211710 4187 server_base.cc:1034] running on GCE node
I20260812 09:55:14.212741 4187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:14.213946 4187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:14.215157 4187 hybrid_clock.cc:648] HybridClock initialized: now 1786528514215135 us; error 35 us; skew 500 ppm
Aug 12 09:55:14 dist-test-slave-2w3w krb5kdc[4172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:14.218636 4187 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:14.219892 4187 webserver.cc:460] Webserver started at http://127.11.118.190:42409/ using document root <none> and password file <none>
I20260812 09:55:14.220927 4187 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:14.221047 4187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:14.221311 4187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:14.223719 4187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "4c73f579ac8149d68e05058927165f53"
format_stamp: "Formatted at 2026-08-12 09:55:14 on dist-test-slave-2w3w"
server_key: "69ae73f6940c9190c97e661741e9cdde"
server_key_iv: "ff8805dc440011941cd64d9e05eb7503"
server_key_version: "encryptionkey@0"
I20260812 09:55:14.224349 4187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "4c73f579ac8149d68e05058927165f53"
format_stamp: "Formatted at 2026-08-12 09:55:14 on dist-test-slave-2w3w"
server_key: "69ae73f6940c9190c97e661741e9cdde"
server_key_iv: "ff8805dc440011941cd64d9e05eb7503"
server_key_version: "encryptionkey@0"
I20260812 09:55:14.228814 4187 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:55:14.231772 4204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:14.233194 4187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:55:14.233356 4187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "4c73f579ac8149d68e05058927165f53"
format_stamp: "Formatted at 2026-08-12 09:55:14 on dist-test-slave-2w3w"
server_key: "69ae73f6940c9190c97e661741e9cdde"
server_key_iv: "ff8805dc440011941cd64d9e05eb7503"
server_key_version: "encryptionkey@0"
I20260812 09:55:14.233491 4187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:14.238605 4187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:14.242120 4187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:14.242353 4187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:14.250633 4187 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:40279
I20260812 09:55:14.250702 4265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:40279 every 8 connection(s)
I20260812 09:55:14.251794 4187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:14.255240 4266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:14.261366 4266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53: Bootstrap starting.
I20260812 09:55:14.261497 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4187
I20260812 09:55:14.261662 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:14.261970 11738 external_mini_cluster.cc:1428] Setting key 438459dcbe26bbbae3544c3d6bc3e7f4
I20260812 09:55:14.264429 4266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:14.265254 4266 log.cc:824] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:14.267988 4266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53: No bootstrap required, opened a new log
I20260812 09:55:14.268397 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:14.263546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39615 (local address 127.11.118.190:40279)
0812 09:55:14.264121 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:14.264137 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:14.264180 (+ 43us) server_negotiation.cc:407] Connection header received
0812 09:55:14.265025 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:14.265047 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:14.265360 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:14.265794 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:14.266704 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:14.266710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:14.266726 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:14.266739 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:14.266802 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:14.266829 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:14.267011 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:14.267216 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 09:55:14.267385 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":160,"threads_started":1}
I20260812 09:55:14.271898 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:14.272858 4266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } }
I20260812 09:55:14.273170 4266 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:14.273236 4266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c73f579ac8149d68e05058927165f53, State: Initialized, Role: FOLLOWER
I20260812 09:55:14.273799 4266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } }
I20260812 09:55:14.273979 4266 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:14.274089 4266 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:14.274209 4266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:14.275676 4266 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } }
I20260812 09:55:14.276150 4266 leader_election.cc:302] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c73f579ac8149d68e05058927165f53; no voters:
I20260812 09:55:14.276300 4269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:14.274244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57663 (local address 127.11.118.190:40279)
0812 09:55:14.274406 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:14.274412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:14.274570 (+ 158us) server_negotiation.cc:407] Connection header received
0812 09:55:14.274678 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:14.274684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:14.274748 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:14.274853 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:14.275831 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:14.275835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:14.275838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:14.275851 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:14.275885 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:14.275899 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:14.276023 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:14.276081 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 09:55:14.276128 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:55:14.276600 4266 leader_election.cc:288] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:14.276728 4278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:14.277001 4278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [term 1 LEADER]: Becoming Leader. State: Replica: 4c73f579ac8149d68e05058927165f53, State: Running, Role: LEADER
I20260812 09:55:14.277346 4278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } }
I20260812 09:55:14.278129 4266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:14.279345 4280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c73f579ac8149d68e05058927165f53. Latest consensus state: current_term: 1 leader_uuid: "4c73f579ac8149d68e05058927165f53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } } }
I20260812 09:55:14.279526 4280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:14.279332 4279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c73f579ac8149d68e05058927165f53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c73f579ac8149d68e05058927165f53" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40279 } } }
I20260812 09:55:14.279800 4279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:14.280390 4289 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:14.283398 4289 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:14.289954 4289 catalog_manager.cc:1347] Generated new cluster ID: ec837902b12f4653b6bb128cfd09d775
I20260812 09:55:14.290045 4289 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:14.309564 4289 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:14.309993 4289 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:14.318540 4289 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c73f579ac8149d68e05058927165f53: Generated new TSK 0
I20260812 09:55:14.319518 4289 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:14.324803 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4187
2026-08-12T09:55:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1566 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:14 dist-test-slave-2w3w krb5kdc[4302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:14 dist-test-slave-2w3w krb5kdc[4302](info): set up 2 sockets
Aug 12 09:55:14 dist-test-slave-2w3w krb5kdc[4302](info): commencing operation
krb5kdc: starting...
W20260812 09:55:15.472510 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:15.624707 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40215
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:33841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:15.744045 4317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:15.744351 4317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:15.744434 4317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:15.748905 4317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:15.748993 4317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:15.749014 4317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:15.749032 4317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:15.749048 4317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:15.755174 4317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:33841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:15.756405 4317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:15.757486 4317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:15.767267 4325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:15.767287 4323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:15.767313 4322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:15.767706 4317 server_base.cc:1034] running on GCE node
I20260812 09:55:15.768318 4317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:15.769502 4317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:15.770705 4317 hybrid_clock.cc:648] HybridClock initialized: now 1786528515770666 us; error 60 us; skew 500 ppm
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:15.773809 4317 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:15.775054 4317 webserver.cc:460] Webserver started at http://127.11.118.190:37821/ using document root <none> and password file <none>
I20260812 09:55:15.775651 4317 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:15.775753 4317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:15.776007 4317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:15.778218 4317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "ae891ff075e4485db0a6344cf4d3492a"
format_stamp: "Formatted at 2026-08-12 09:55:15 on dist-test-slave-2w3w"
server_key: "7f0a6286d6e68cd2a6df4187246c7fb2"
server_key_iv: "925baf0a5393583a8600609cda1c1df1"
server_key_version: "encryptionkey@0"
I20260812 09:55:15.778821 4317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "ae891ff075e4485db0a6344cf4d3492a"
format_stamp: "Formatted at 2026-08-12 09:55:15 on dist-test-slave-2w3w"
server_key: "7f0a6286d6e68cd2a6df4187246c7fb2"
server_key_iv: "925baf0a5393583a8600609cda1c1df1"
server_key_version: "encryptionkey@0"
I20260812 09:55:15.782830 4317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:55:15.785449 4333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:15.786777 4317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 09:55:15.786937 4317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "ae891ff075e4485db0a6344cf4d3492a"
format_stamp: "Formatted at 2026-08-12 09:55:15 on dist-test-slave-2w3w"
server_key: "7f0a6286d6e68cd2a6df4187246c7fb2"
server_key_iv: "925baf0a5393583a8600609cda1c1df1"
server_key_version: "encryptionkey@0"
I20260812 09:55:15.787153 4317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:15.814527 4317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:15.817997 4317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:15.818234 4317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:15.826092 4317 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:40215
I20260812 09:55:15.826117 4398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:40215 every 8 connection(s)
I20260812 09:55:15.827281 4317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:15.830248 4399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:15.833611 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4317
I20260812 09:55:15.833777 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:15.834065 11738 external_mini_cluster.cc:1428] Setting key 552048acfccca6f88cf56bad0e465598
I20260812 09:55:15.836876 4399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a: Bootstrap starting.
I20260812 09:55:15.839814 4399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:15.840830 4399 log.cc:824] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:15.843772 4399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a: No bootstrap required, opened a new log
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528515, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:15.847625 4399 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } }
I20260812 09:55:15.847931 4399 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:15.848021 4399 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae891ff075e4485db0a6344cf4d3492a, State: Initialized, Role: FOLLOWER
I20260812 09:55:15.848551 4399 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } }
I20260812 09:55:15.848713 4399 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:15.848784 4399 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:15.848915 4399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:15.850001 4399 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } }
I20260812 09:55:15.850425 4399 leader_election.cc:302] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae891ff075e4485db0a6344cf4d3492a; no voters:
I20260812 09:55:15.850785 4399 leader_election.cc:288] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:15.850937 4404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:15.851256 4404 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [term 1 LEADER]: Becoming Leader. State: Replica: ae891ff075e4485db0a6344cf4d3492a, State: Running, Role: LEADER
I20260812 09:55:15.851608 4404 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } }
I20260812 09:55:15.851679 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:15.835678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55689 (local address 127.11.118.190:40215)
0812 09:55:15.836141 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:15.836158 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:15.836195 (+ 37us) server_negotiation.cc:407] Connection header received
0812 09:55:15.836828 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:15.836845 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:15.837255 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:15.837560 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:15.838562 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:15.839684 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:15.841030 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:15.841808 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:15.841971 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:15.845103 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:15.845109 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:15.845125 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:15.845158 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:15.847797 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:15.848386 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:15.848391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:15.848396 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:15.848528 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:15.848869 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:15.848873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:15.848877 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:15.849377 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:15.849624 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:15.849927 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 09:55:15.850394 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":158,"threads_started":1}
I20260812 09:55:15.852262 4399 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:15.852938 4404 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae891ff075e4485db0a6344cf4d3492a. Latest consensus state: current_term: 1 leader_uuid: "ae891ff075e4485db0a6344cf4d3492a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } } }
I20260812 09:55:15.853075 4404 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:15.853535 4410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:15.853473 4405 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae891ff075e4485db0a6344cf4d3492a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae891ff075e4485db0a6344cf4d3492a" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40215 } } }
I20260812 09:55:15.853598 4405 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:15.855471 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:15.857208 4410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:15.864240 4410 catalog_manager.cc:1347] Generated new cluster ID: c37d028200674f7cab0a9a877f587bb0
I20260812 09:55:15.864352 4410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:15.869892 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:15.858089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41637 (local address 127.11.118.190:40215)
0812 09:55:15.858205 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:15.858209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:15.858801 (+ 592us) server_negotiation.cc:407] Connection header received
0812 09:55:15.858923 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:15.858926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:15.859010 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:15.859102 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:15.860057 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:15.860930 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:15.862399 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:15.862813 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:15.863154 (+ 341us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:15.865432 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:15.865437 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:15.865440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:15.865474 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:15.867427 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:15.868077 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:15.868081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:15.868083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:15.868184 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:15.868517 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:15.868521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:15.868523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:15.868786 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:15.868899 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:15.869326 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 09:55:15.869692 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:55:15.881644 4410 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:15.882690 4410 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:15.887341 4410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae891ff075e4485db0a6344cf4d3492a: Generated new TSK 0
I20260812 09:55:15.888167 4410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:15.892638 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4317
2026-08-12T09:55:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1566 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4436](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4436](info): set up 2 sockets
Aug 12 09:55:15 dist-test-slave-2w3w krb5kdc[4436](info): commencing operation
krb5kdc: starting...
W20260812 09:55:17.031597 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:17 dist-test-slave-2w3w krb5kdc[4436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:17.184223 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37813
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:45109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:37813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:17.299835 4452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:17.300179 4452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:17.300266 4452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:17.304502 4452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:17.304608 4452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:17.304648 4452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:17.304708 4452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:17.304749 4452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:17.310447 4452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:45109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:37813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:37813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:17.311753 4452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:17.312817 4452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:17.321921 4459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:17.321869 4464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:17.321902 4452 server_base.cc:1034] running on GCE node
W20260812 09:55:17.321867 4460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:17.322819 4452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:17.324046 4452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:17.325240 4452 hybrid_clock.cc:648] HybridClock initialized: now 1786528517325221 us; error 36 us; skew 500 ppm
Aug 12 09:55:17 dist-test-slave-2w3w krb5kdc[4436](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528517, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:17.328384 4452 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:17.329342 4452 webserver.cc:460] Webserver started at http://127.11.118.190:33649/ using document root <none> and password file <none>
I20260812 09:55:17.329927 4452 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:17.329995 4452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:17.330212 4452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:17.332474 4452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "4b91d9c031aa45edadc76bdd407935ce"
format_stamp: "Formatted at 2026-08-12 09:55:17 on dist-test-slave-2w3w"
server_key: "c539bb5ef3e90c985613ec9a3644c4ab"
server_key_iv: "5c2bedb60dbb94d4afebf095417d62ef"
server_key_version: "encryptionkey@0"
I20260812 09:55:17.333097 4452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "4b91d9c031aa45edadc76bdd407935ce"
format_stamp: "Formatted at 2026-08-12 09:55:17 on dist-test-slave-2w3w"
server_key: "c539bb5ef3e90c985613ec9a3644c4ab"
server_key_iv: "5c2bedb60dbb94d4afebf095417d62ef"
server_key_version: "encryptionkey@0"
I20260812 09:55:17.337363 4452 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:55:17.340404 4472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:17.341953 4452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:55:17.342150 4452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "4b91d9c031aa45edadc76bdd407935ce"
format_stamp: "Formatted at 2026-08-12 09:55:17 on dist-test-slave-2w3w"
server_key: "c539bb5ef3e90c985613ec9a3644c4ab"
server_key_iv: "5c2bedb60dbb94d4afebf095417d62ef"
server_key_version: "encryptionkey@0"
I20260812 09:55:17.342294 4452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:17.372790 4452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:17.376940 4452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:17.377302 4452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:17.385462 4452 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:37813
I20260812 09:55:17.385493 4540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:37813 every 8 connection(s)
I20260812 09:55:17.386499 4452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:17.389642 4541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:17.393450 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4452
I20260812 09:55:17.393649 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:17.393968 11738 external_mini_cluster.cc:1428] Setting key ef139174d9c326b27c39c6b01c6eee81
I20260812 09:55:17.397151 4541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce: Bootstrap starting.
I20260812 09:55:17.399744 4541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:17.400591 4541 log.cc:824] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:17.403223 4541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce: No bootstrap required, opened a new log
I20260812 09:55:17.404013 4545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:17.395716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38715 (local address 127.11.118.190:37813)
0812 09:55:17.396232 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:17.396248 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:17.396287 (+ 39us) server_negotiation.cc:407] Connection header received
0812 09:55:17.396981 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:17.396999 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:17.397406 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:17.397764 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:17.398217 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:17.399350 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:17.400378 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:17.400975 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:17.401178 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:17.402117 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:17.402123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:17.402139 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:17.402557 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:17.402619 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:17.402642 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:17.402760 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:17.402889 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 09:55:17.403178 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":160,"threads_started":1}
I20260812 09:55:17.407088 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:17.407307 4541 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } }
I20260812 09:55:17.407581 4541 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:17.407671 4541 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b91d9c031aa45edadc76bdd407935ce, State: Initialized, Role: FOLLOWER
I20260812 09:55:17.408113 4541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } }
I20260812 09:55:17.408277 4541 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:17.408367 4541 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:17.408493 4541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:17.409787 4541 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } }
I20260812 09:55:17.410209 4541 leader_election.cc:302] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b91d9c031aa45edadc76bdd407935ce; no voters:
I20260812 09:55:17.410604 4541 leader_election.cc:288] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:17.410717 4554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:17.410992 4554 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [term 1 LEADER]: Becoming Leader. State: Replica: 4b91d9c031aa45edadc76bdd407935ce, State: Running, Role: LEADER
I20260812 09:55:17.411355 4554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } }
I20260812 09:55:17.412226 4541 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:17.413110 4555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b91d9c031aa45edadc76bdd407935ce. Latest consensus state: current_term: 1 leader_uuid: "4b91d9c031aa45edadc76bdd407935ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } } }
I20260812 09:55:17.413251 4555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:17.413625 4556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b91d9c031aa45edadc76bdd407935ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b91d9c031aa45edadc76bdd407935ce" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 37813 } } }
I20260812 09:55:17.413743 4556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:17.414074 4563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:17.414878 4545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:17.409368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37909 (local address 127.11.118.190:37813)
0812 09:55:17.409510 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:17.409516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:17.409753 (+ 237us) server_negotiation.cc:407] Connection header received
0812 09:55:17.409832 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:17.409835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:17.409896 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:17.409983 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:17.410423 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:17.411290 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:17.412455 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:17.412795 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:17.412923 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:17.414092 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:17.414097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:17.414100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:17.414116 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:17.414149 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:17.414164 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:17.414229 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:17.414662 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 09:55:17.414749 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 09:55:17.417526 4563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:17.423918 4563 catalog_manager.cc:1347] Generated new cluster ID: 669af89bd886444ca863ee059c232d34
I20260812 09:55:17.424021 4563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:17.448637 4563 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:17.450212 4563 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:17.459115 4563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b91d9c031aa45edadc76bdd407935ce: Generated new TSK 0
I20260812 09:55:17.459898 4563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:17.466171 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4452
2026-08-12T09:55:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:17 dist-test-slave-2w3w krb5kdc[4578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:17 dist-test-slave-2w3w krb5kdc[4578](info): set up 2 sockets
Aug 12 09:55:17 dist-test-slave-2w3w krb5kdc[4578](info): commencing operation
krb5kdc: starting...
W20260812 09:55:18.627178 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:18 dist-test-slave-2w3w krb5kdc[4578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:18.774684 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33693
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:43201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:33693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:18.895093 4592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:18.895431 4592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:18.895514 4592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:18.899705 4592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:18.899827 4592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:18.899868 4592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:18.899928 4592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:18.899986 4592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:18.905817 4592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:43201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:33693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:33693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:18.907119 4592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:18.908298 4592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:18.918267 4598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:18.918213 4602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:18.918213 4599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:18.918552 4592 server_base.cc:1034] running on GCE node
I20260812 09:55:18.919317 4592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:18.920636 4592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:18.921870 4592 hybrid_clock.cc:648] HybridClock initialized: now 1786528518921850 us; error 36 us; skew 500 ppm
Aug 12 09:55:18 dist-test-slave-2w3w krb5kdc[4578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528518, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:18.930260 4592 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:18.931548 4592 webserver.cc:460] Webserver started at http://127.11.118.190:35217/ using document root <none> and password file <none>
I20260812 09:55:18.932194 4592 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:18.932296 4592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:18.932562 4592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:18.934868 4592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "34cd387f8d5b495888095e9e61339f51"
format_stamp: "Formatted at 2026-08-12 09:55:18 on dist-test-slave-2w3w"
server_key: "6aea7373a8200d53f5e093b31e5bc2dd"
server_key_iv: "010a6172d5fb4be592355cf984200ff9"
server_key_version: "encryptionkey@0"
I20260812 09:55:18.935582 4592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "34cd387f8d5b495888095e9e61339f51"
format_stamp: "Formatted at 2026-08-12 09:55:18 on dist-test-slave-2w3w"
server_key: "6aea7373a8200d53f5e093b31e5bc2dd"
server_key_iv: "010a6172d5fb4be592355cf984200ff9"
server_key_version: "encryptionkey@0"
I20260812 09:55:18.939755 4592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 09:55:18.942533 4614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:18.944199 4592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:55:18.944381 4592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "34cd387f8d5b495888095e9e61339f51"
format_stamp: "Formatted at 2026-08-12 09:55:18 on dist-test-slave-2w3w"
server_key: "6aea7373a8200d53f5e093b31e5bc2dd"
server_key_iv: "010a6172d5fb4be592355cf984200ff9"
server_key_version: "encryptionkey@0"
I20260812 09:55:18.944533 4592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:18.949826 4592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:18.953557 4592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:18.953799 4592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:18.961928 4592 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:33693
I20260812 09:55:18.961968 4672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:33693 every 8 connection(s)
I20260812 09:55:18.962944 4592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:18.963310 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4592
I20260812 09:55:18.963459 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:18.963800 11738 external_mini_cluster.cc:1428] Setting key 40c05959820a2779dfcab9993471e8f7
I20260812 09:55:18.966388 4673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:18.969938 4676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:18.965374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57423 (local address 127.11.118.190:33693)
0812 09:55:18.965854 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:18.965873 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:18.965917 (+ 44us) server_negotiation.cc:407] Connection header received
0812 09:55:18.966809 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:18.966833 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:18.967227 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:18.967616 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:18.968442 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:18.968450 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:18.968466 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:18.968479 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:18.968547 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:18.968573 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:18.968727 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:18.968794 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 09:55:18.968949 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":141,"threads_started":1}
I20260812 09:55:18.973167 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:18.973477 4673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51: Bootstrap starting.
I20260812 09:55:18.976660 4673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:18.977761 4673 log.cc:824] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:18.977968 4676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:18.975805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50201 (local address 127.11.118.190:33693)
0812 09:55:18.976009 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:18.976016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:18.976249 (+ 233us) server_negotiation.cc:407] Connection header received
0812 09:55:18.976351 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:18.976354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:18.976406 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:18.976485 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:18.977342 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:18.977345 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:18.977347 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 09:55:18.977358 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:18.977388 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 09:55:18.977400 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:18.977483 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:18.977612 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 09:55:18.977649 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 09:55:18.980430 4673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51: No bootstrap required, opened a new log
I20260812 09:55:18.984313 4673 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } }
I20260812 09:55:18.984622 4673 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 09:55:18.984714 4673 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34cd387f8d5b495888095e9e61339f51, State: Initialized, Role: FOLLOWER
I20260812 09:55:18.985239 4673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } }
I20260812 09:55:18.985409 4673 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 09:55:18.985486 4673 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 09:55:18.985594 4673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:18.986766 4673 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } }
I20260812 09:55:18.987186 4673 leader_election.cc:302] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34cd387f8d5b495888095e9e61339f51; no voters:
I20260812 09:55:18.987589 4673 leader_election.cc:288] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 09:55:18.987782 4684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:18.988099 4684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [term 1 LEADER]: Becoming Leader. State: Replica: 34cd387f8d5b495888095e9e61339f51, State: Running, Role: LEADER
I20260812 09:55:18.988473 4684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } }
I20260812 09:55:18.989040 4673 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:18.990415 4686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34cd387f8d5b495888095e9e61339f51. Latest consensus state: current_term: 1 leader_uuid: "34cd387f8d5b495888095e9e61339f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } } }
I20260812 09:55:18.990571 4686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:18.990984 4685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34cd387f8d5b495888095e9e61339f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34cd387f8d5b495888095e9e61339f51" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 33693 } } }
I20260812 09:55:18.991073 4693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:18.991092 4685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:18.994793 4693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:19.001587 4693 catalog_manager.cc:1347] Generated new cluster ID: 922bd8defb1f482e96e6dd9ebda98771
I20260812 09:55:19.001693 4693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:19.020025 4693 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:19.020397 4693 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:19.027534 4693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34cd387f8d5b495888095e9e61339f51: Generated new TSK 0
I20260812 09:55:19.028362 4693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 09:55:19.035133 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4592
2026-08-12T09:55:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1567 ms)
[----------] 18 tests from AuthTokenIssuingTest (28665 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:19 dist-test-slave-2w3w krb5kdc[4707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:19 dist-test-slave-2w3w krb5kdc[4707](info): set up 2 sockets
Aug 12 09:55:19 dist-test-slave-2w3w krb5kdc[4707](info): commencing operation
krb5kdc: starting...
W20260812 09:55:20.181641 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:20.340715 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40363
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:20.464538 4721 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:20.464941 4721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:20.465019 4721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:20.465116 4721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:20.469389 4721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:20.469521 4721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:20.469559 4721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:20.469599 4721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:20.469635 4721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:20.476845 4721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:40363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:20.478201 4721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:20.479377 4721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:20.489777 4727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:20.489912 4721 server_base.cc:1034] running on GCE node
W20260812 09:55:20.489843 4730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:20.489777 4728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:20.491243 4721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:20.492604 4721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:20.493809 4721 hybrid_clock.cc:648] HybridClock initialized: now 1786528520493725 us; error 161 us; skew 500 ppm
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:20.498126 4721 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:20.499373 4721 webserver.cc:460] Webserver started at http://127.11.118.190:45589/ using document root <none> and password file <none>
I20260812 09:55:20.500202 4721 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:20.500344 4721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:20.500614 4721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:20.504468 4721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "39321d08a66047638e6492fe15754099"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "eafb298ddf08df2d0964eae956ab56a4"
server_key_iv: "cb330ac527c7ccd60d4fcd4080b66247"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.505285 4721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "39321d08a66047638e6492fe15754099"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "eafb298ddf08df2d0964eae956ab56a4"
server_key_iv: "cb330ac527c7ccd60d4fcd4080b66247"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.510159 4721 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 09:55:20.513535 4737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:20.515357 4721 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 09:55:20.515487 4721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "39321d08a66047638e6492fe15754099"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "eafb298ddf08df2d0964eae956ab56a4"
server_key_iv: "cb330ac527c7ccd60d4fcd4080b66247"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.515601 4721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:20.531991 4721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:20.536857 4721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:20.537310 4721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:20.547924 4721 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:40363
I20260812 09:55:20.548280 4799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:40363 every 8 connection(s)
I20260812 09:55:20.549350 4721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:20.550529 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4721
I20260812 09:55:20.550699 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:20.551113 11738 external_mini_cluster.cc:1428] Setting key c0d103a7f522f507234ec0c37c817c8e
I20260812 09:55:20.552736 4800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:20.559428 4800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.118.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.189@KRBTEST.COM" created.
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:20.579495 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.562825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40363 (local address 127.0.0.1:48840)
0812 09:55:20.563537 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.563582 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:20.564692 (+ 1110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:20.565764 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:20.565775 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:20.566349 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:20.566846 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.566870 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.568686 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.568694 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.570220 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.570232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.571072 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.571077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.571180 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.571892 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:20.571912 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:20.573626 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:20.575961 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.575973 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.575987 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.576247 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.576623 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.576628 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.576631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.576759 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.577500 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:20.577507 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:20.577657 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 09:55:20.577845 (+ 188us) client_negotiation.cc:240] Negotiation successful
0812 09:55:20.578245 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"spinlock_wait_cycles":896,"thread_start_us":242,"threads_started":1}
I20260812 09:55:20.579495 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.562825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48840 (local address 127.11.118.190:40363)
0812 09:55:20.563406 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:20.563427 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:20.563710 (+ 283us) server_negotiation.cc:407] Connection header received
0812 09:55:20.565065 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:20.565070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:20.565276 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:20.565484 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:20.567337 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.568391 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.570382 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.570850 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.571088 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.573822 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:20.573828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:20.573841 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:20.573863 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:20.575819 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.576392 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.576397 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.576399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.576520 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.576874 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.576878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.576880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.577351 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:20.577512 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:20.577931 (+ 419us) server_negotiation.cc:299] Negotiation successful
0812 09:55:20.578306 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":417,"thread_start_us":165,"threads_started":1}
I20260812 09:55:20.583609 4800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:20.584967 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.584589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34080)
0812 09:55:20.584745 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.584846 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 09:55:20.585551 4738 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
I20260812 09:55:20.587296 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.586574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34092)
0812 09:55:20.586894 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.587171 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260812 09:55:20.587635 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40761: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
I20260812 09:55:20.593294 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:40761
--webserver_interface=127.11.118.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:55:20.637010 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } attempt: 1
I20260812 09:55:20.638056 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.637709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34102)
0812 09:55:20.637911 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.637974 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 09:55:20.638787 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.638576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34108)
0812 09:55:20.638679 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.638731 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260812 09:55:20.638911 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40761: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
I20260812 09:55:20.707046 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } attempt: 2
I20260812 09:55:20.707998 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.707660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34122)
0812 09:55:20.707826 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.707918 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 09:55:20.708761 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.708543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34136)
0812 09:55:20.708654 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.708707 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 09:55:20.708900 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40761: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
W20260812 09:55:20.720839 4808 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:20.721303 4808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:20.721350 4808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:20.721421 4808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:20.725950 4808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:20.726095 4808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:20.726137 4808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:20.726167 4808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:20.726204 4808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:20.736116 4808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:40761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.118.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:20.738122 4808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:20.739655 4808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:20.752207 4814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:20.752231 4815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:20.752485 4808 server_base.cc:1034] running on GCE node
W20260812 09:55:20.752805 4817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:20.753518 4808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:20.755012 4808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:20.756481 4808 hybrid_clock.cc:648] HybridClock initialized: now 1786528520756453 us; error 55 us; skew 500 ppm
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:20.760447 4808 init.cc:377] Logged in from keytab as kudu/127.11.118.189@KRBTEST.COM (short username kudu)
I20260812 09:55:20.761757 4808 webserver.cc:460] Webserver started at http://127.11.118.189:35089/ using document root <none> and password file <none>
I20260812 09:55:20.762542 4808 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:20.762643 4808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:20.762904 4808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:20.766155 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data/instance:
uuid: "513db8d597b74f9099dbf262a1330350"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "e4c93183fe550d5acaab23bf9f44bd2f"
server_key_iv: "fdfd38a80858c9c2c86a5da2611c159a"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.767122 4808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal/instance:
uuid: "513db8d597b74f9099dbf262a1330350"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "e4c93183fe550d5acaab23bf9f44bd2f"
server_key_iv: "fdfd38a80858c9c2c86a5da2611c159a"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.773322 4808 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 09:55:20.777335 4825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:20.778841 4808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 09:55:20.779079 4808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "513db8d597b74f9099dbf262a1330350"
format_stamp: "Formatted at 2026-08-12 09:55:20 on dist-test-slave-2w3w"
server_key: "e4c93183fe550d5acaab23bf9f44bd2f"
server_key_iv: "fdfd38a80858c9c2c86a5da2611c159a"
server_key_version: "encryptionkey@0"
I20260812 09:55:20.779227 4808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:20.800068 4808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:20.800115 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } attempt: 3
I20260812 09:55:20.801128 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.800733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34144)
0812 09:55:20.800932 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.801019 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 09:55:20.801915 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.801702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34156)
0812 09:55:20.801809 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.801860 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 09:55:20.802079 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:40761: Network error: Client connection negotiation failed: client connection to 127.11.118.189:40761: connect: Connection refused (error 111)
I20260812 09:55:20.804194 4808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:20.804420 4808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:20.812647 4808 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.189:40761
I20260812 09:55:20.813000 4890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.189:40761 every 8 connection(s)
I20260812 09:55:20.813735 4808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
I20260812 09:55:20.816738 4891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:20.821066 4891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:20.823321 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4808
I20260812 09:55:20.823464 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-1/wal/instance
I20260812 09:55:20.823729 11738 external_mini_cluster.cc:1428] Setting key cee31ba9d47f2770e0810995b56e9705
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.118.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.188@KRBTEST.COM" created.
I20260812 09:55:20.839828 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.823203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48846 (local address 127.11.118.190:40363)
0812 09:55:20.823401 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:20.823406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:20.824595 (+ 1189us) server_negotiation.cc:407] Connection header received
0812 09:55:20.826353 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:20.826359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:20.826448 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:20.826576 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:20.828599 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.829509 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.831356 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.831620 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.831747 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.834914 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:20.834917 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:20.834920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:20.834948 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:20.836880 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.837668 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.837677 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.837679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.837817 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.838265 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.838269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.838271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.838569 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:20.838695 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:20.839452 (+ 757us) server_negotiation.cc:299] Negotiation successful
0812 09:55:20.839613 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 09:55:20.840787 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.823693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40363 (local address 127.0.0.1:48846)
0812 09:55:20.824370 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.824439 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:20.825989 (+ 1550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:20.826935 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:20.826949 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:20.827604 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:20.828393 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.828417 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.829686 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.829689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.831209 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.831222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.831815 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.831820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.832003 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.832714 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:20.832733 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:20.834607 (+ 1874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:20.837051 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.837059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.837087 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.837442 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.837946 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.837949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.837952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.838139 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.838696 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:20.838705 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:20.839136 (+ 431us) client_negotiation.cc:769] Sending connection context
0812 09:55:20.839365 (+ 229us) client_negotiation.cc:240] Negotiation successful
0812 09:55:20.839775 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":161,"threads_started":1}
I20260812 09:55:20.842589 4891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:20.856941 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.843235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34162)
0812 09:55:20.843347 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.843362 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:20.843454 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:20.844370 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:20.844374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:20.844560 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:20.844674 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.844680 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.846339 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.846342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.847052 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.847069 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.848007 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.848009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.848101 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.848725 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:20.848741 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:20.852782 (+ 4041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:20.855236 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.855241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.855243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.855461 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.855818 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.855823 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.855825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.855909 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.856433 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:20.856436 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:20.856526 (+ 90us) client_negotiation.cc:769] Sending connection context
0812 09:55:20.856652 (+ 126us) client_negotiation.cc:240] Negotiation successful
0812 09:55:20.856803 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 09:55:20.857281 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.843398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34162 (local address 127.11.118.189:40761)
0812 09:55:20.843768 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:20.843785 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:20.843814 (+ 29us) server_negotiation.cc:407] Connection header received
0812 09:55:20.843870 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:20.843880 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:20.844113 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:20.844319 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:20.844807 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.846153 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.847195 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.847875 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.848009 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.852975 (+ 4966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:20.852991 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:20.853007 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:20.853032 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:20.855099 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.855588 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.855597 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.855599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.855718 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.856010 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.856015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.856017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.856320 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:20.856499 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:20.856878 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 09:55:20.857070 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":117,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
I20260812 09:55:20.859225 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:40901
--webserver_interface=127.11.118.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:55:20.859393 4891 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:20.860275 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.859968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43204)
0812 09:55:20.860110 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.860204 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 09:55:20.860617 4829 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
I20260812 09:55:20.862377 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.862011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43220)
0812 09:55:20.862186 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.862271 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 09:55:20.862594 4891 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:40901: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
I20260812 09:55:20.911918 4891 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } attempt: 1
I20260812 09:55:20.912961 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.912592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43224)
0812 09:55:20.912775 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.912874 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 09:55:20.913760 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.913525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43230)
0812 09:55:20.913646 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.913704 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 09:55:20.913941 4891 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:40901: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
I20260812 09:55:20.945308 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } attempt: 4
Aug 12 09:55:20 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:20.955359 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.946221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.11.118.189:40761)
0812 09:55:20.946362 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:20.946369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:20.946388 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:55:20.946592 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:20.946595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:20.946646 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:20.946736 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:20.947282 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.948214 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.949456 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.949717 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.949833 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.952073 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:20.952076 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:20.952078 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:20.952105 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:20.953565 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.954056 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.954060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.954061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.954141 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:20.954440 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:20.954444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:20.954447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:20.954649 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:20.954776 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:20.955092 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 09:55:20.955221 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 09:55:20.955359 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.946056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34166)
0812 09:55:20.946302 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.946321 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:20.946471 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:20.946756 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:20.946759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:20.947032 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:20.947149 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.947155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.948346 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.948353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.949310 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:20.949320 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:20.949854 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:20.949858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:20.949965 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:20.950547 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:20.950560 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:20.951907 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:20.953701 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.953704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.953707 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.953932 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.954242 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:20.954245 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:20.954247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:20.954332 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:20.954770 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:20.954773 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:20.954882 (+ 109us) client_negotiation.cc:769] Sending connection context
0812 09:55:20.955016 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 09:55:20.955176 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260812 09:55:20.956652 4800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:20.957598 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.957339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43234)
0812 09:55:20.957471 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.957528 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 09:55:20.958422 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.958164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43248)
0812 09:55:20.958283 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.958358 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 09:55:20.958590 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:40901: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
I20260812 09:55:20.982157 4891 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } attempt: 2
W20260812 09:55:20.982283 4897 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:20.982760 4897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:20.982810 4897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:20.982870 4897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 09:55:20.983273 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.982836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43252)
0812 09:55:20.983092 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.983170 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 09:55:20.984357 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:20.984052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43264)
0812 09:55:20.984233 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:20.984293 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260812 09:55:20.984589 4891 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:40901: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
W20260812 09:55:20.987749 4897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:20.987812 4897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:20.987833 4897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:20.987851 4897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:20.987901 4897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:20.993825 4897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:40363,127.11.118.189:40761,127.11.118.188:40901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:40901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.118.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:20.995105 4897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:20.996340 4897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:21.005581 4903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:21.005653 4904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:21.005782 4897 server_base.cc:1034] running on GCE node
W20260812 09:55:21.005631 4907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:21.006449 4897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:21.007786 4897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:21.009060 4897 hybrid_clock.cc:648] HybridClock initialized: now 1786528521009035 us; error 34 us; skew 500 ppm
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:21.012295 4897 init.cc:377] Logged in from keytab as kudu/127.11.118.188@KRBTEST.COM (short username kudu)
I20260812 09:55:21.013266 4897 webserver.cc:460] Webserver started at http://127.11.118.188:36731/ using document root <none> and password file <none>
I20260812 09:55:21.013864 4897 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:21.013931 4897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:21.014158 4897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:21.016448 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data/instance:
uuid: "28fd705024e6432093488000b47eeb12"
format_stamp: "Formatted at 2026-08-12 09:55:21 on dist-test-slave-2w3w"
server_key: "4db5b5f636e5e036767a7a93d7a78324"
server_key_iv: "fa902f0a8a2b76f8d450c4945b2b2bb5"
server_key_version: "encryptionkey@0"
I20260812 09:55:21.017069 4897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal/instance:
uuid: "28fd705024e6432093488000b47eeb12"
format_stamp: "Formatted at 2026-08-12 09:55:21 on dist-test-slave-2w3w"
server_key: "4db5b5f636e5e036767a7a93d7a78324"
server_key_iv: "fa902f0a8a2b76f8d450c4945b2b2bb5"
server_key_version: "encryptionkey@0"
I20260812 09:55:21.017767 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } attempt: 1
I20260812 09:55:21.018538 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.018252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43270)
0812 09:55:21.018401 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.018468 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 09:55:21.019460 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.019203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43278)
0812 09:55:21.019351 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.019403 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 09:55:21.019650 4800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:40901: Network error: Client connection negotiation failed: client connection to 127.11.118.188:40901: connect: Connection refused (error 111)
I20260812 09:55:21.021720 4897 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:55:21.024704 4915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:21.026146 4897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 09:55:21.026341 4897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "28fd705024e6432093488000b47eeb12"
format_stamp: "Formatted at 2026-08-12 09:55:21 on dist-test-slave-2w3w"
server_key: "4db5b5f636e5e036767a7a93d7a78324"
server_key_iv: "fa902f0a8a2b76f8d450c4945b2b2bb5"
server_key_version: "encryptionkey@0"
I20260812 09:55:21.026495 4897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:21.042830 4897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:21.046607 4897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:21.046855 4897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:21.055500 4897 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.188:40901
I20260812 09:55:21.055989 4979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.188:40901 every 8 connection(s)
I20260812 09:55:21.056681 4897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
I20260812 09:55:21.058231 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 4897
I20260812 09:55:21.058377 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786528216186196-11738-0/minicluster-data/master-2/wal/instance
I20260812 09:55:21.058683 11738 external_mini_cluster.cc:1428] Setting key 679f9fdc1ccfca1c5c5050b9fd8da90e
I20260812 09:55:21.059978 4980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:21.064047 4980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:21.075393 4984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.060177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43288 (local address 127.11.118.188:40901)
0812 09:55:21.060718 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.060735 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.060779 (+ 44us) server_negotiation.cc:407] Connection header received
0812 09:55:21.061502 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.061520 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.061859 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.062206 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.063159 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.064262 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.065252 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.065992 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.066152 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.069366 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.069372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.069389 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.069418 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.071742 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.072432 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.072438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.072444 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.072569 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.072923 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.072928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.072930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.073541 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.073766 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.074145 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.074473 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":164,"threads_started":1}
I20260812 09:55:21.076581 4891 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } attempt: 3
I20260812 09:55:21.076820 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.065819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:40363 (local address 127.0.0.1:48860)
0812 09:55:21.066271 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.066329 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:21.066548 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:21.066928 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:21.066933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:21.067527 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:21.067748 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.067758 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.068771 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.068774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.069503 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.069513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.070009 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.070012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.070142 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.070603 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:21.070615 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:21.072553 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:21.074874 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.074885 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.074891 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.075214 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.075525 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.075529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.075531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.075655 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.076160 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:21.076166 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:21.076287 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 09:55:21.076435 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 09:55:21.076638 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":182,"threads_started":1}
I20260812 09:55:21.077433 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.065911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.11.118.190:40363)
0812 09:55:21.066058 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.066064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.066413 (+ 349us) server_negotiation.cc:407] Connection header received
0812 09:55:21.066675 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.066679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.066739 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.066830 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.067889 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.068631 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.069642 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.069882 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.070007 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.072800 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.072805 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.072807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.072837 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.074749 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.075337 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.075343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.075349 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.075428 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.075832 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.075836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.075837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.076051 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.076136 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.076518 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.076687 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 09:55:21.078662 4980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:21.086838 4800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } attempt: 2
I20260812 09:55:21.088192 4893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.077079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43296)
0812 09:55:21.077247 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.077285 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:21.077387 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:21.077706 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:21.077710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:21.077894 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:21.077993 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.077999 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.079158 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.079165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.080151 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.080166 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.080663 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.080666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.080754 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.081372 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:21.081388 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:21.083117 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:21.086273 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.086276 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.086278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.086597 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.087000 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.087004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.087007 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.087115 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.087616 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:21.087620 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:21.087746 (+ 126us) client_negotiation.cc:769] Sending connection context
0812 09:55:21.087917 (+ 171us) client_negotiation.cc:240] Negotiation successful
0812 09:55:21.088063 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 09:55:21.088794 4984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.077346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43296 (local address 127.11.118.188:40901)
0812 09:55:21.077446 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.077453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.077469 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:55:21.077505 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.077510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.077560 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.078137 (+ 577us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.078234 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.079014 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.080311 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.080542 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.080656 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.083263 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.083266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.083269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.083302 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.086146 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.086713 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.086717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.086719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.086866 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.087229 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.087232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.087233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.087487 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.088423 (+ 936us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.088512 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.088642 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 09:55:21.089331 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.079437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.11.118.189:40761)
0812 09:55:21.079566 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.079569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.079579 (+ 10us) server_negotiation.cc:407] Connection header received
0812 09:55:21.079608 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.079610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.079644 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.079733 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.080154 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.080946 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.081882 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.082231 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.082344 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.084723 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.084727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.084729 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.084756 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.086696 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.087538 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.087541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.087543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.087632 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.087985 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.087990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.087994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.088505 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.088589 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.089012 (+ 423us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.089141 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 09:55:21.089884 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.079226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:40761 (local address 127.0.0.1:34168)
0812 09:55:21.079339 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.079355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:21.079431 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:21.079751 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:21.079754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:21.079939 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:21.080034 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.080039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.081080 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.081085 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.081741 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.081751 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.082361 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.082365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.082472 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.083024 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:21.083039 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:21.084579 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:21.086852 (+ 2273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.086859 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.086864 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.087417 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.087755 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.087758 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.087760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.087872 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.088676 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:21.088680 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:21.088776 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 09:55:21.089535 (+ 759us) client_negotiation.cc:240] Negotiation successful
0812 09:55:21.089689 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 09:55:21.090596 4980 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:21.091981 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.078230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48874 (local address 127.11.118.190:40363)
0812 09:55:21.078347 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.078351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.079028 (+ 677us) server_negotiation.cc:407] Connection header received
0812 09:55:21.079074 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.079080 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.079136 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.079205 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.080250 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.080992 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.082214 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.082631 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.082801 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.086589 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.086596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.086599 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.086635 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.089201 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.089807 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.089811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.089813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.089938 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.090539 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.090543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.090545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.090792 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.091115 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.091688 (+ 573us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.091825 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 09:55:21.093586 4891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: Bootstrap starting.
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528521, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:55:21.096982 4891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:21.098042 4891 log.cc:824] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: Log is configured to *not* fsync() on all Append() calls
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:21.101058 4984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.091382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.11.118.188:40901)
0812 09:55:21.091479 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.091483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.091495 (+ 12us) server_negotiation.cc:407] Connection header received
0812 09:55:21.091530 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.091532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.091580 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.091653 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.092176 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.092882 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.094070 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.094390 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.094521 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.097186 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.097190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.097192 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.097220 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.099088 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.099597 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.099602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.099604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.099700 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.100019 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.100022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.100024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.100286 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.100387 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.100656 (+ 269us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.100843 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":38}
I20260812 09:55:21.101070 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.091160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43308)
0812 09:55:21.091297 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.091314 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:21.091394 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:21.091750 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:21.091754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:21.091931 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:21.092048 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.092058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.092992 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.092997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.093655 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.093665 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.094517 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.094521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.094654 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.095393 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:21.095409 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:21.097025 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:21.099212 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.099216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.099218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.099465 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.099813 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.099819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.099823 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.099925 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.100373 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:21.100376 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:21.100476 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 09:55:21.100588 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 09:55:21.100760 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":23}
I20260812 09:55:21.101410 4891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: No bootstrap required, opened a new log
I20260812 09:55:21.103868 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.093289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.11.118.189:40761)
0812 09:55:21.093411 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.093415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.093964 (+ 549us) server_negotiation.cc:407] Connection header received
0812 09:55:21.094063 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.094067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.094120 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.094199 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.095037 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.095650 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.096434 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.096810 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.096926 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.099991 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.099998 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.100003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.100031 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.101865 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.102376 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.102380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.102382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.102475 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.102772 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.102776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.102777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.103032 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.103220 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.103575 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.103711 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 09:55:21.104962 4980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: Bootstrap starting.
I20260812 09:55:21.106174 4891 raft_consensus.cc:348] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.106446 4891 raft_consensus.cc:729] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 513db8d597b74f9099dbf262a1330350, State: Initialized, Role: FOLLOWER
Aug 12 09:55:21 dist-test-slave-2w3w krb5kdc[4707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528520, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:55:21.106775 4891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.107599 4989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.107765 4989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.108572 4891 sys_catalog.cc:564] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:21.108639 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 09:55:21.110904 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.087472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:40901 (local address 127.0.0.1:43302)
0812 09:55:21.087693 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:21.087710 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:21.087783 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:21.090243 (+ 2460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:21.090249 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:21.090460 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:21.090580 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.090587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.103135 (+ 12548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.103139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.104053 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:21.104070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.104763 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.104767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:21.104857 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.105439 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:21.105453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:21.107060 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:21.109107 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.109110 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.109113 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.109336 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.109733 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:21.109737 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:21.109741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:21.109840 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:21.110357 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:21.110360 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:21.110485 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 09:55:21.110571 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 09:55:21.110730 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260812 09:55:21.111559 4980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:21.110236 4770 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "39321d08a66047638e6492fe15754099"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48874
I20260812 09:55:21.111714 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.087560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.11.118.188:40901)
0812 09:55:21.089823 (+ 2263us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.089836 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.089849 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:55:21.089888 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.089894 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.089947 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.098606 (+ 8659us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.098757 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.099565 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.104231 (+ 4666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.104601 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.105149 (+ 548us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.107210 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.107214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.107217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.107243 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.108973 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.109494 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.109497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.109499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.109593 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.109989 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.109992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.109994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.110235 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.111242 (+ 1007us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.111322 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.111454 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":126,"threads_started":1}
I20260812 09:55:21.112819 4980 log.cc:824] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: Log is configured to *not* fsync() on all Append() calls
W20260812 09:55:21.114789 5002 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 09:55:21.114799 4800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: Bootstrap starting.
W20260812 09:55:21.114895 5002 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:21.112670 4808 master_runner.cc:186] Error getting master registration for 127.11.118.190:40363: OK, instance_id { permanent_uuid: "39321d08a66047638e6492fe15754099" instance_seqno: 1786528520545200 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 09:55:21.116199 4808 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 09:55:21.117849 4800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:21.118821 4800 log.cc:824] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:21.121599 4980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: No bootstrap required, opened a new log
I20260812 09:55:21.124768 4800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: No bootstrap required, opened a new log
I20260812 09:55:21.126036 4980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.126317 4980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fd705024e6432093488000b47eeb12, State: Initialized, Role: FOLLOWER
I20260812 09:55:21.126686 4980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.127435 5007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.127740 5007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.128057 4800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.128276 4800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39321d08a66047638e6492fe15754099, State: Initialized, Role: FOLLOWER
I20260812 09:55:21.128350 4980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:21.128611 4800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.129191 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.129448 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.130050 4800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:21.130086 4770 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 09:55:21.130182 4770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:21.131769 4770 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.132992 4770 leader_election.cc:288] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [CANDIDATE]: Term 1 election: Requested vote from peers 513db8d597b74f9099dbf262a1330350 (127.11.118.189:40761), 28fd705024e6432093488000b47eeb12 (127.11.118.188:40901)
W20260812 09:55:21.134794 5022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:21.135025 5022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:21.134944 4862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39321d08a66047638e6492fe15754099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "513db8d597b74f9099dbf262a1330350"
I20260812 09:55:21.134944 4949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39321d08a66047638e6492fe15754099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "28fd705024e6432093488000b47eeb12"
I20260812 09:55:21.135234 4949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:21.135236 4862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:21.136675 4949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39321d08a66047638e6492fe15754099 in term 1.
I20260812 09:55:21.136675 4862 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39321d08a66047638e6492fe15754099 in term 1.
I20260812 09:55:21.137187 4738 leader_election.cc:302] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39321d08a66047638e6492fe15754099, 513db8d597b74f9099dbf262a1330350; no voters:
I20260812 09:55:21.137555 5009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:21.137827 5009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [term 1 LEADER]: Becoming Leader. State: Replica: 39321d08a66047638e6492fe15754099, State: Running, Role: LEADER
I20260812 09:55:21.138228 5009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } }
I20260812 09:55:21.140722 5035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39321d08a66047638e6492fe15754099. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.140851 5035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:21.144323 4721 master_runner.cc:263] No leader master found from master 39321d08a66047638e6492fe15754099
I20260812 09:55:21.144408 4721 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 09:55:21.144695 5033 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:21.144779 5033 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:21.153195 5044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:21.154430 5044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:21.156607 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.139064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43318 (local address 127.11.118.188:40901)
0812 09:55:21.139188 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.139192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.146273 (+ 7081us) server_negotiation.cc:407] Connection header received
0812 09:55:21.146486 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.146489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.146537 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.146589 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.147746 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.148588 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.149818 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.150225 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.150307 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.152432 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.152436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.152439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.152468 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.154394 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.155038 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.155042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.155043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.155145 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.155473 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.155476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.155478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.155705 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.155840 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.156239 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.156398 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 09:55:21.167378 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.144800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.11.118.190:40363)
0812 09:55:21.144914 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.144919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.157356 (+ 12437us) server_negotiation.cc:407] Connection header received
0812 09:55:21.157537 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.157540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.157591 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.157645 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.158611 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.159433 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.160493 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.160831 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.160915 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.162929 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.162936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.162942 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.162999 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.165078 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.165683 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.165687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.165689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.165785 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.166169 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.166175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.166189 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.166444 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.166569 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.167029 (+ 460us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.167184 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:55:21.171160 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:21.145825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34186 (local address 127.11.118.189:40761)
0812 09:55:21.145953 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.145957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.158069 (+ 12112us) server_negotiation.cc:407] Connection header received
0812 09:55:21.158276 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.158279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.158360 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.158426 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.159373 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.160135 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.162317 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:21.162737 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:21.162834 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:21.167130 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:21.167137 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:21.167142 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:21.167188 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:21.168949 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.169394 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.169398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.169399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.169494 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:21.169816 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:21.169819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:21.169821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:21.170252 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:21.170409 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:21.170800 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 09:55:21.170951 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 09:55:21.172083 4949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [term 1 FOLLOWER]: Refusing update from remote peer 39321d08a66047638e6492fe15754099: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:55:21.172371 4862 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [term 1 FOLLOWER]: Refusing update from remote peer 39321d08a66047638e6492fe15754099: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:55:21.173121 5009 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:55:21.173615 5035 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:55:21.177587 4989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39321d08a66047638e6492fe15754099. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.177758 4989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.178056 5007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39321d08a66047638e6492fe15754099. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.178181 5007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.190227 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.190400 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:21.190924 5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.191203 5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:21.191470 4989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.191622 4989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.192106 5007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39321d08a66047638e6492fe15754099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39321d08a66047638e6492fe15754099" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 40363 } } peers { permanent_uuid: "513db8d597b74f9099dbf262a1330350" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 40761 } } peers { permanent_uuid: "28fd705024e6432093488000b47eeb12" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 40901 } } }
I20260812 09:55:21.192260 5007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:21.192222 5051 mvcc.cc:205] Tried to move back new op lower bound from 7317620822711255040 to 7317620822586028032. Current Snapshot: MvccSnapshot[applied={T|T < 7317620822711255040}]
I20260812 09:55:21.195124 5050 mvcc.cc:205] Tried to move back new op lower bound from 7317620822711255040 to 7317620822586028032. Current Snapshot: MvccSnapshot[applied={T|T < 7317620822711255040}]
I20260812 09:55:21.198617 5044 catalog_manager.cc:1347] Generated new cluster ID: d22892d9e28b461ba995d750159d4764
I20260812 09:55:21.198712 5044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:21.256403 5044 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:21.258137 5044 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:21.276338 5044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39321d08a66047638e6492fe15754099: Generated new TSK 0
I20260812 09:55:21.277266 5044 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:55:21.314035 4986 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.310662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43320 (local address 127.11.118.188:40901)
0812 09:55:21.310827 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.310832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.312874 (+ 2042us) server_negotiation.cc:407] Connection header received
0812 09:55:21.313089 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.313093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.313146 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.313199 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.313890 (+ 691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43320: BlockingRecv error: recv got EOF from 127.0.0.1:43320 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 09:55:21.315718 4803 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.311586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.11.118.190:40363)
0812 09:55:21.311717 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.311722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.314613 (+ 2891us) server_negotiation.cc:407] Connection header received
0812 09:55:21.314849 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.314853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.314912 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.315018 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.315585 (+ 567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48884: BlockingRecv error: recv got EOF from 127.0.0.1:48884 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 09:55:21.317236 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.312271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.11.118.189:40761)
0812 09:55:21.312394 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.312399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.316269 (+ 3870us) server_negotiation.cc:407] Connection header received
0812 09:55:21.316452 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.316455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.316510 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.316562 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.317104 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34190: BlockingRecv error: recv got EOF from 127.0.0.1:34190 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260812 09:55:21.322817 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.320856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34194 (local address 127.11.118.189:40761)
0812 09:55:21.320982 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.320986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.321565 (+ 579us) server_negotiation.cc:407] Connection header received
0812 09:55:21.321909 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.321915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.322004 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.322065 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.322677 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34194: BlockingRecv error: recv got EOF from 127.0.0.1:34194 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 09:55:21.329033 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.327189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.11.118.189:40761)
0812 09:55:21.327313 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.327317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.327912 (+ 595us) server_negotiation.cc:407] Connection header received
0812 09:55:21.328146 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.328151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.328212 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.328268 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.328912 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34196: BlockingRecv error: recv got EOF from 127.0.0.1:34196 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 09:55:21.335901 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.333833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.11.118.189:40761)
0812 09:55:21.333993 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.333998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.334696 (+ 698us) server_negotiation.cc:407] Connection header received
0812 09:55:21.335030 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.335035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.335105 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.335167 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.335769 (+ 602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34212: BlockingRecv error: recv got EOF from 127.0.0.1:34212 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260812 09:55:21.344679 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.342677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.11.118.189:40761)
0812 09:55:21.342861 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.342866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.343520 (+ 654us) server_negotiation.cc:407] Connection header received
0812 09:55:21.343769 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.343773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.343837 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.343899 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.344550 (+ 651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34224: BlockingRecv error: recv got EOF from 127.0.0.1:34224 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260812 09:55:21.357358 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.355575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34228 (local address 127.11.118.189:40761)
0812 09:55:21.355697 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.355701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.356264 (+ 563us) server_negotiation.cc:407] Connection header received
0812 09:55:21.356487 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.356491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.356545 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.356598 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.357234 (+ 636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34228: BlockingRecv error: recv got EOF from 127.0.0.1:34228 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260812 09:55:21.377811 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.376507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34230 (local address 127.11.118.189:40761)
0812 09:55:21.376632 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.376636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.376847 (+ 211us) server_negotiation.cc:407] Connection header received
0812 09:55:21.376989 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.376993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.377054 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.377156 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.377691 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34230: BlockingRecv error: recv got EOF from 127.0.0.1:34230 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260812 09:55:21.413559 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.412191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.11.118.189:40761)
0812 09:55:21.412378 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.412382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.412537 (+ 155us) server_negotiation.cc:407] Connection header received
0812 09:55:21.412725 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.412729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.412787 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.412883 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.413401 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34236: BlockingRecv error: recv got EOF from 127.0.0.1:34236 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 09:55:21.481489 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.480082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34252 (local address 127.11.118.189:40761)
0812 09:55:21.480232 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.480237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.480390 (+ 153us) server_negotiation.cc:407] Connection header received
0812 09:55:21.480533 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.480537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.480597 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.480716 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.481369 (+ 653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34252: BlockingRecv error: recv got EOF from 127.0.0.1:34252 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 09:55:21.613481 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.612044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34264 (local address 127.11.118.189:40761)
0812 09:55:21.612203 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.612207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.612360 (+ 153us) server_negotiation.cc:407] Connection header received
0812 09:55:21.612482 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.612485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.612538 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.612625 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.613328 (+ 703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34264: BlockingRecv error: recv got EOF from 127.0.0.1:34264 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260812 09:55:21.873896 4896 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:21.872504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34276 (local address 127.11.118.189:40761)
0812 09:55:21.872748 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:21.872753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:21.872774 (+ 21us) server_negotiation.cc:407] Connection header received
0812 09:55:21.872886 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:21.872896 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:21.872947 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:21.873224 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:21.873761 (+ 537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34276: BlockingRecv error: recv got EOF from 127.0.0.1:34276 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
I20260812 09:55:22.116457 5002 catalog_manager.cc:1259] Loaded cluster ID: d22892d9e28b461ba995d750159d4764
I20260812 09:55:22.116613 5002 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: loading cluster ID for follower catalog manager: success
I20260812 09:55:22.118412 5002 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: acquiring CA information for follower catalog manager: success
I20260812 09:55:22.119897 5002 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 513db8d597b74f9099dbf262a1330350: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:55:22.136929 5022 catalog_manager.cc:1259] Loaded cluster ID: d22892d9e28b461ba995d750159d4764
I20260812 09:55:22.137037 5022 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: loading cluster ID for follower catalog manager: success
I20260812 09:55:22.139452 5022 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: acquiring CA information for follower catalog manager: success
I20260812 09:55:22.140902 5022 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 28fd705024e6432093488000b47eeb12: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:55:22.393563 5135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:22.389250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34278 (local address 127.11.118.189:40761)
0812 09:55:22.389579 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:22.389583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:22.389599 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:55:22.389680 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:22.389682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:22.389813 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:22.389918 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:22.390274 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.390866 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.391930 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.392178 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.392283 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:22.392594 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:22.393055 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:22.393155 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:22.393241 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 09:55:22.393368 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":146,"threads_started":1}
I20260812 09:55:22.401793 5142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:22.397802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.11.118.188:40901)
0812 09:55:22.398089 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:22.398096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:22.398115 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:55:22.398215 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:22.398218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:22.398347 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:22.398484 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:22.398729 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.399353 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.400207 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.400460 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.400577 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:22.400906 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:22.401362 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:22.401508 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:22.401558 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 09:55:22.401620 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":92,"threads_started":1}
I20260812 09:55:22.410060 5142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:22.405428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43330 (local address 127.11.118.188:40901)
0812 09:55:22.405544 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:22.405550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:22.406009 (+ 459us) server_negotiation.cc:407] Connection header received
0812 09:55:22.406204 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:22.406209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:22.406307 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:22.406396 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:22.406743 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.407623 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.408771 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.409063 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.409207 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:22.409485 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:22.409585 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:22.409689 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:22.409802 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 09:55:22.409864 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 09:55:22.410457 5135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:22.405821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.11.118.189:40761)
0812 09:55:22.405979 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:22.405985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:22.406263 (+ 278us) server_negotiation.cc:407] Connection header received
0812 09:55:22.406505 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:22.406508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:22.406565 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:22.406644 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:22.406906 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.407497 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.409076 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.409428 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.409501 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:22.409940 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:22.410017 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:22.410062 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:22.410244 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 09:55:22.410302 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 09:55:22.411062 5151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:22.405363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48898 (local address 127.11.118.190:40363)
0812 09:55:22.405637 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:22.405652 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:22.405679 (+ 27us) server_negotiation.cc:407] Connection header received
0812 09:55:22.405942 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:22.405945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:22.406132 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:22.406278 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:22.406575 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.407566 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.409062 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:22.409451 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:22.409557 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:22.409912 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:22.410288 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:22.410396 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:22.410797 (+ 401us) server_negotiation.cc:299] Negotiation successful
0812 09:55:22.410877 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":71,"threads_started":1}
I20260812 09:55:22.414629 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4721
I20260812 09:55:22.427152 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4808
I20260812 09:55:22.437419 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 4897
2026-08-12T09:55:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3405 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 09:55:22 dist-test-slave-2w3w krb5kdc[5156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 09:55:22 dist-test-slave-2w3w krb5kdc[5156](info): set up 2 sockets
Aug 12 09:55:22 dist-test-slave-2w3w krb5kdc[5156](info): commencing operation
krb5kdc: starting...
W20260812 09:55:23.609675 11738 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/test-user.keytab.
Aug 12 09:55:23 dist-test-slave-2w3w krb5kdc[5156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T09:55:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T09:55:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.118.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
Entry for principal kudu/127.11.118.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab.
I20260812 09:55:23.758531 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45219
--webserver_interface=127.11.118.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:45089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 09:55:23.878990 5170 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:23.879398 5170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:23.879457 5170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:23.879544 5170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:23.883838 5170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:23.883970 5170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:23.884009 5170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:23.884049 5170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:23.884084 5170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:23.890134 5170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:45089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.190.keytab
--principal=kudu/127.11.118.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.190:45219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.118.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:23.891486 5170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:23.892966 5170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:23.902652 5178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:23.902652 5175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:23.902709 5176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:23.902994 5170 server_base.cc:1034] running on GCE node
I20260812 09:55:23.903798 5170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:23.905064 5170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:23.906286 5170 hybrid_clock.cc:648] HybridClock initialized: now 1786528523906265 us; error 41 us; skew 500 ppm
Aug 12 09:55:23 dist-test-slave-2w3w krb5kdc[5156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:23.909818 5170 init.cc:377] Logged in from keytab as kudu/127.11.118.190@KRBTEST.COM (short username kudu)
I20260812 09:55:23.911036 5170 webserver.cc:460] Webserver started at http://127.11.118.190:37965/ using document root <none> and password file <none>
I20260812 09:55:23.911643 5170 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:23.911711 5170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:23.911911 5170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:23.914186 5170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data/instance:
uuid: "ea485fa2c77d489f8fcb491abac01c58"
format_stamp: "Formatted at 2026-08-12 09:55:23 on dist-test-slave-2w3w"
server_key: "4776475234693edad7293abcc93711a9"
server_key_iv: "b0bc9b8f2ff2dc8c11a43529985fc4f2"
server_key_version: "encryptionkey@0"
I20260812 09:55:23.914800 5170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance:
uuid: "ea485fa2c77d489f8fcb491abac01c58"
format_stamp: "Formatted at 2026-08-12 09:55:23 on dist-test-slave-2w3w"
server_key: "4776475234693edad7293abcc93711a9"
server_key_iv: "b0bc9b8f2ff2dc8c11a43529985fc4f2"
server_key_version: "encryptionkey@0"
I20260812 09:55:23.919307 5170 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 09:55:23.922322 5185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:23.923821 5170 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:55:23.923964 5170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal
uuid: "ea485fa2c77d489f8fcb491abac01c58"
format_stamp: "Formatted at 2026-08-12 09:55:23 on dist-test-slave-2w3w"
server_key: "4776475234693edad7293abcc93711a9"
server_key_iv: "b0bc9b8f2ff2dc8c11a43529985fc4f2"
server_key_version: "encryptionkey@0"
I20260812 09:55:23.924086 5170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:23.946051 5170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:23.950014 5170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:23.950217 5170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:23.958825 5170 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.190:45219
I20260812 09:55:23.959360 5245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.190:45219 every 8 connection(s)
I20260812 09:55:23.959992 5170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/data/info.pb
I20260812 09:55:23.963212 5246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:23.967541 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 5170
I20260812 09:55:23.967686 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-0/wal/instance
I20260812 09:55:23.967991 11738 external_mini_cluster.cc:1428] Setting key 6d5c6d781e4314f0fd031096e31d3b83
I20260812 09:55:23.968245 5246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.118.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.189@KRBTEST.COM" created.
Aug 12 09:55:23 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:23.988538 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:23.971541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45219 (local address 127.0.0.1:44998)
0812 09:55:23.972224 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:23.972265 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:23.973385 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:23.974251 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:23.974257 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:23.974803 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:23.975193 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:23.975209 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:23.976390 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:23.976393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:23.977151 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:23.977160 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:23.977932 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:23.977936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:23.978044 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:23.978708 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:23.978733 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:23.982142 (+ 3409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:23.984810 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:23.984821 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:23.984830 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:23.985133 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:23.985584 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:23.985586 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:23.985587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:23.985708 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:23.986614 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:23.986620 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:23.986849 (+ 229us) client_negotiation.cc:769] Sending connection context
0812 09:55:23.987081 (+ 232us) client_negotiation.cc:240] Negotiation successful
0812 09:55:23.987409 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"spinlock_wait_cycles":13568,"thread_start_us":165,"threads_started":1}
I20260812 09:55:23.988543 5249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:23.971540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44998 (local address 127.11.118.190:45219)
0812 09:55:23.972048 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:23.972068 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:23.972403 (+ 335us) server_negotiation.cc:407] Connection header received
0812 09:55:23.973813 (+ 1410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:23.973823 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:23.974049 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:23.974253 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:23.975349 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:23.976252 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:23.977295 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:23.977758 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:23.977940 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:23.982338 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:23.982344 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:23.982356 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:23.982378 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:23.984653 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:23.985299 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:23.985308 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:23.985313 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:23.985481 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:23.985816 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:23.985822 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:23.985826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:23.986474 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:23.986628 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:23.987199 (+ 571us) server_negotiation.cc:299] Negotiation successful
0812 09:55:23.987556 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":116,"server-negotiator.queue_time_us":347,"thread_start_us":189,"threads_started":1}
I20260812 09:55:23.991501 5246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:23.992451 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:23.992120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33580)
0812 09:55:23.992291 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:23.992376 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260812 09:55:23.992692 5188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
I20260812 09:55:23.993785 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:23.993515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33588)
0812 09:55:23.993639 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:23.993714 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 09:55:23.993965 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:35557: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
Entry for principal kudu/127.11.118.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab.
I20260812 09:55:24.002897 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:35557
--webserver_interface=127.11.118.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:45089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:55:24.043239 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } attempt: 1
I20260812 09:55:24.044329 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.043964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33598)
0812 09:55:24.044148 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.044233 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260812 09:55:24.045233 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.045002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33610)
0812 09:55:24.045120 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.045174 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 09:55:24.045480 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:35557: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
I20260812 09:55:24.113694 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } attempt: 2
I20260812 09:55:24.114820 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.114490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33614)
0812 09:55:24.114649 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.114742 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 09:55:24.115694 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.115420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33630)
0812 09:55:24.115539 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.115596 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 09:55:24.116017 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.189:35557: Network error: Client connection negotiation failed: client connection to 127.11.118.189:35557: connect: Connection refused (error 111)
W20260812 09:55:24.129875 5253 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:24.130692 5253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:24.130846 5253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:24.130936 5253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:24.135528 5253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:24.135637 5253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:24.135676 5253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:24.135749 5253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:24.135789 5253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:24.141698 5253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:45089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.189.keytab
--principal=kudu/127.11.118.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.189:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.118.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:24.143054 5253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:24.144158 5253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 09:55:24.153776 5253 server_base.cc:1034] running on GCE node
W20260812 09:55:24.153781 5261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:24.153781 5258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:24.153808 5259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:24.154819 5253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:24.156242 5253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:24.157450 5253 hybrid_clock.cc:648] HybridClock initialized: now 1786528524157414 us; error 57 us; skew 500 ppm
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:24.161037 5253 init.cc:377] Logged in from keytab as kudu/127.11.118.189@KRBTEST.COM (short username kudu)
I20260812 09:55:24.162184 5253 webserver.cc:460] Webserver started at http://127.11.118.189:46855/ using document root <none> and password file <none>
I20260812 09:55:24.162854 5253 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:24.163033 5253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:24.163582 5253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:24.166281 5253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data/instance:
uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "e2a9a764c9823cc39f2ed9bdd7c9429d"
server_key_iv: "94b1e99d069d1c75bdfbd9d3ac891675"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.166952 5253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal/instance:
uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "e2a9a764c9823cc39f2ed9bdd7c9429d"
server_key_iv: "94b1e99d069d1c75bdfbd9d3ac891675"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.171953 5253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 09:55:24.175096 5268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:24.176553 5253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 09:55:24.176719 5253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal
uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "e2a9a764c9823cc39f2ed9bdd7c9429d"
server_key_iv: "94b1e99d069d1c75bdfbd9d3ac891675"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.176921 5253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:24.195228 5253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:24.199281 5253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:24.199473 5253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:24.207283 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } attempt: 3
I20260812 09:55:24.208333 5253 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.189:35557
I20260812 09:55:24.208695 5329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.189:35557 every 8 connection(s)
I20260812 09:55:24.209764 5253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/data/info.pb
I20260812 09:55:24.212069 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 5253
I20260812 09:55:24.212193 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-1/wal/instance
I20260812 09:55:24.212523 11738 external_mini_cluster.cc:1428] Setting key c8838d4ee3a816e9b504f397fde368b7
I20260812 09:55:24.213574 5331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:24.220091 5331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:24.224180 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.208163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33632)
0812 09:55:24.208319 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.208371 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.208506 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.212104 (+ 3598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.212108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.212353 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.212517 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.212525 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.214505 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.214512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.215635 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.215651 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.216493 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.216497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.216608 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.217262 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.217276 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.218633 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.221695 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.221698 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.221701 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.221953 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.222530 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.222536 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.222540 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.222678 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.223550 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.223553 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.223688 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.223822 (+ 134us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.224004 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.11.118.188@KRBTEST.COM; defaulting to no policy
I20260812 09:55:24.225472 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.209716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33632 (local address 127.11.118.189:35557)
0812 09:55:24.210336 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.210363 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.210405 (+ 42us) server_negotiation.cc:407] Connection header received
0812 09:55:24.211255 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.211277 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.211661 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.212133 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.212727 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.214299 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.215806 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.216336 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.216534 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.218910 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.218916 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.218939 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.219025 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.221520 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.222187 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.222193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.222203 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.222375 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.222812 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.222818 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.222823 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.223412 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.223578 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.223998 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.224327 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":179,"threads_started":1}
I20260812 09:55:24.228034 5246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.118.188@KRBTEST.COM" created.
I20260812 09:55:24.229071 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.228731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54080)
0812 09:55:24.228879 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.228946 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 09:55:24.230011 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.229653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54088)
0812 09:55:24.229874 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.229940 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260812 09:55:24.230259 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:24.235833 5249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.223027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.11.118.190:45219)
0812 09:55:24.223182 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.223188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.223677 (+ 489us) server_negotiation.cc:407] Connection header received
0812 09:55:24.223893 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.223897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.223959 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.224020 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.225062 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.226314 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.227722 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.228228 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.228348 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.231564 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.231570 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.231576 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.231616 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.233481 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.234222 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.234226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.234228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.234335 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.234683 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.234686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.234688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.234919 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.235079 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.235520 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.235654 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 09:55:24.235859 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.222640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45219 (local address 127.0.0.1:45006)
0812 09:55:24.223514 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.223581 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.223728 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.224210 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.224218 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.224706 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.224898 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.224911 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.226475 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.226478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.227492 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.227505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.228514 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.228524 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.228697 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.229606 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.229622 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.231360 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.233642 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.233654 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.233660 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.234007 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.234463 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.234466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.234468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.234567 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.235086 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.235096 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.235238 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.235371 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.235654 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":156,"threads_started":1}
I20260812 09:55:24.237228 5331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:24.252417 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.238255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33634)
0812 09:55:24.238516 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.238530 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.238611 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.239255 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.239257 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.239427 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.239723 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.239730 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.241849 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.241856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.243405 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.243422 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.244157 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.244161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.244259 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.244837 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.244850 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.247549 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.250567 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.250571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.250572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.250801 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.251306 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.251312 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.251317 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.251422 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.251874 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.251877 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.251975 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.252120 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.252268 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":171}
I20260812 09:55:24.252651 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.238300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33634 (local address 127.11.118.189:35557)
0812 09:55:24.238614 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.238619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.238665 (+ 46us) server_negotiation.cc:407] Connection header received
0812 09:55:24.238781 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.238784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.238833 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.239174 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.239858 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.240860 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.243567 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.243975 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.244108 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.247726 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.247730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.247732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.247759 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.250346 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.251021 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.251027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.251029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.251167 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.251555 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.251557 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.251558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.251777 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.251889 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.252238 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.252366 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260812 09:55:24.253530 5331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:24.254519 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.254161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54096)
0812 09:55:24.254304 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.254421 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 09:55:24.254878 5272 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
Entry for principal kudu/127.11.118.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab.
I20260812 09:55:24.256088 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.255764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54102)
0812 09:55:24.255934 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.256000 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 09:55:24.256340 5331 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
I20260812 09:55:24.256665 11738 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskilB4wR/build/debug/bin/kudu
/tmp/dist-test-taskilB4wR/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:42177
--webserver_interface=127.11.118.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.118.148:45089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 09:55:24.261452 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 1
I20260812 09:55:24.262395 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.262090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54116)
0812 09:55:24.262250 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.262319 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 09:55:24.263458 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.263044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54126)
0812 09:55:24.263278 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.263357 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 09:55:24.263689 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
I20260812 09:55:24.305693 5331 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 1
I20260812 09:55:24.306834 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.306460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54134)
0812 09:55:24.306679 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.306751 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 09:55:24.307862 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.307542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54142)
0812 09:55:24.307675 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.307734 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 09:55:24.308048 5331 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
I20260812 09:55:24.338917 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 2
I20260812 09:55:24.340013 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.339631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54150)
0812 09:55:24.339836 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.339916 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 09:55:24.340934 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.340645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54166)
0812 09:55:24.340782 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.340854 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 09:55:24.341091 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
I20260812 09:55:24.376238 5331 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 2
I20260812 09:55:24.377218 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.376881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54176)
0812 09:55:24.377066 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.377134 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260812 09:55:24.378214 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.377978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54184)
0812 09:55:24.378098 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.378151 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 09:55:24.378387 5331 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
W20260812 09:55:24.380888 5339 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 09:55:24.381222 5339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 09:55:24.381249 5339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 09:55:24.381290 5339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 09:55:24.385768 5339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 09:55:24.385854 5339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 09:55:24.385874 5339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 09:55:24.385892 5339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 09:55:24.385908 5339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 09:55:24.391973 5339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.118.148:45089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.118.190:45219,127.11.118.189:35557,127.11.118.188:42177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/krb5kdc/kudu_127.11.118.188.keytab
--principal=kudu/127.11.118.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.118.188:42177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.118.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 12 Aug 2026 08:09:26 UTC on ccycloud.quasar-kitgea.root.comops.site
build id 4582138
I20260812 09:55:24.393262 5339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 09:55:24.394397 5339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 09:55:24.404074 5347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:24.404066 5345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 09:55:24.404066 5344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 09:55:24.404721 5339 server_base.cc:1034] running on GCE node
I20260812 09:55:24.405441 5339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 09:55:24.406754 5339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 09:55:24.408032 5339 hybrid_clock.cc:648] HybridClock initialized: now 1786528524408016 us; error 42 us; skew 500 ppm
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 09:55:24.411623 5339 init.cc:377] Logged in from keytab as kudu/127.11.118.188@KRBTEST.COM (short username kudu)
I20260812 09:55:24.412696 5339 webserver.cc:460] Webserver started at http://127.11.118.188:45611/ using document root <none> and password file <none>
I20260812 09:55:24.413349 5339 fs_manager.cc:359] Metadata directory not provided
I20260812 09:55:24.413457 5339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 09:55:24.413709 5339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 09:55:24.416095 5339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data/instance:
uuid: "7c9eb20bcd5d4eaebdccc959556504c6"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "9c8ce799f72d0bd40c3f78f117cd51b7"
server_key_iv: "989f642c515f2b3a258ea98d9e4f4552"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.416728 5339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal/instance:
uuid: "7c9eb20bcd5d4eaebdccc959556504c6"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "9c8ce799f72d0bd40c3f78f117cd51b7"
server_key_iv: "989f642c515f2b3a258ea98d9e4f4552"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.421087 5339 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 09:55:24.424041 5354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 09:55:24.425487 5339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 09:55:24.425669 5339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data,/tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal
uuid: "7c9eb20bcd5d4eaebdccc959556504c6"
format_stamp: "Formatted at 2026-08-12 09:55:24 on dist-test-slave-2w3w"
server_key: "9c8ce799f72d0bd40c3f78f117cd51b7"
server_key_iv: "989f642c515f2b3a258ea98d9e4f4552"
server_key_version: "encryptionkey@0"
I20260812 09:55:24.425817 5339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 09:55:24.440279 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 3
I20260812 09:55:24.441414 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.440878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54190)
0812 09:55:24.441241 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.441316 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 09:55:24.442157 5339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 09:55:24.442212 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.441973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54192)
0812 09:55:24.442097 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.442153 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260812 09:55:24.442356 5246 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.118.188:42177: Network error: Client connection negotiation failed: client connection to 127.11.118.188:42177: connect: Connection refused (error 111)
I20260812 09:55:24.445760 5339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 09:55:24.446013 5339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 09:55:24.453974 5339 rpc_server.cc:307] RPC server started. Bound to: 127.11.118.188:42177
I20260812 09:55:24.454273 5417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.118.188:42177 every 8 connection(s)
I20260812 09:55:24.455303 5339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/data/info.pb
I20260812 09:55:24.455639 11738 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskilB4wR/build/debug/bin/kudu as pid 5339
I20260812 09:55:24.455808 11738 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskilB4wR/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786528216186196-11738-0/minicluster-data/master-2/wal/instance
I20260812 09:55:24.456156 11738 external_mini_cluster.cc:1428] Setting key b6a6cdb3dd0721fe261552db3de77b9d
I20260812 09:55:24.458604 5418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 09:55:24.462597 5418 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:55:24.469616 5331 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 3
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
I20260812 09:55:24.472595 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.457618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54206 (local address 127.11.118.188:42177)
0812 09:55:24.458110 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.458126 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.458162 (+ 36us) server_negotiation.cc:407] Connection header received
0812 09:55:24.458917 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.458937 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.459347 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.459689 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.460603 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.461696 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.462652 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.463268 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.463471 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.466557 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.466563 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.466572 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.466601 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.468703 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.469268 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.469273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.469278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.469492 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.469900 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.469906 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.469908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.470504 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.470740 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.471114 (+ 374us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.471492 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"spinlock_wait_cycles":1792,"thread_start_us":166,"threads_started":1}
I20260812 09:55:24.475656 5422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.464631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.190:45219 (local address 127.0.0.1:45008)
0812 09:55:24.465109 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.465155 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.465322 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.465635 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.465640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.466077 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.466230 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.466237 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.467187 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.467189 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.468306 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.468318 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.468805 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.468809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.468931 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.469455 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.469469 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.471595 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.473579 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.473591 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.473597 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.473950 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.474281 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.474287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.474289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.474377 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.474915 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.474920 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.475077 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.475227 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.475452 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":139,"threads_started":1}
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.189@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:55:24.476039 5249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.464673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45008 (local address 127.11.118.190:45219)
0812 09:55:24.464851 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.464856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.465253 (+ 397us) server_negotiation.cc:407] Connection header received
0812 09:55:24.465432 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.465436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.465491 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.465580 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.466401 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.467035 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.468443 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.468676 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.468764 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.471763 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.471766 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.471768 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.471796 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.473450 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.474076 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.474082 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.474087 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.474195 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.474476 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.474480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.474482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.474749 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.474854 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.475740 (+ 886us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.475878 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 09:55:24.477628 5418 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:24.481616 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.470233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54216 (local address 127.11.118.188:42177)
0812 09:55:24.470685 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.470694 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.471050 (+ 356us) server_negotiation.cc:407] Connection header received
0812 09:55:24.471195 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.471197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.471254 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.471828 (+ 574us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.471925 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.472651 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.473717 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.474049 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.474161 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.476653 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.476658 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.476660 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.476685 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.479378 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.479870 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.479873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.479875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.479983 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.480576 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.480581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.480582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.480833 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.480968 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.481276 (+ 308us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.481418 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":200,"threads_started":1}
I20260812 09:55:24.481714 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.470160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54216)
0812 09:55:24.470950 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.470999 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.471099 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.471406 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.471410 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.471605 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.471714 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.471721 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.472788 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.472793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.473561 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.473574 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.474174 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.474178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.474269 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.474794 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.474808 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.476504 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.479484 (+ 2980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.479488 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.479490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.479752 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.480342 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.480345 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.480346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.480461 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.480970 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.480975 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.481086 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.481188 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.481437 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"mutex_wait_us":3}
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.190@KRBTEST.COM
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:24.486409 5331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: Bootstrap starting.
I20260812 09:55:24.486938 5424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.475778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45020 (local address 127.11.118.190:45219)
0812 09:55:24.476093 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.476108 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.476491 (+ 383us) server_negotiation.cc:407] Connection header received
0812 09:55:24.476612 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.476615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.476658 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.476771 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.477620 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.478363 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.479328 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.479654 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.479770 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.482902 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.482907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.482911 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.482948 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.484950 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.485478 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.485482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.485484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.485587 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.485881 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.485885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.485886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.486096 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.486343 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.486574 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.486719 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
I20260812 09:55:24.487746 5422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.478197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.189:35557 (local address 127.0.0.1:33644)
0812 09:55:24.478385 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.478399 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.478470 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.478928 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.478931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.479131 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.479230 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.479240 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.480220 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.480227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.480905 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.480938 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.481874 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.481881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.481980 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.482515 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.482529 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.483984 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.485953 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.485956 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.485958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.486217 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.486562 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.486565 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.486567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.486657 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.487211 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.487215 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.487315 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.487433 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.487575 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260812 09:55:24.488399 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.478277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33644 (local address 127.11.118.189:35557)
0812 09:55:24.478682 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.478687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.478704 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:55:24.478746 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.478748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.478803 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.478892 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.479364 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.480107 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.481083 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.481554 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.481666 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.484190 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.484193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.484196 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.484227 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.485817 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.486351 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.486354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.486356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.486445 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.486763 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.486766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.486768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.487063 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.487163 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.487518 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.487650 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":45}
I20260812 09:55:24.489008 5418 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } has no permanent_uuid. Determining permanent_uuid...
I20260812 09:55:24.489923 5331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:24.490875 5331 log.cc:824] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:24.493297 5331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: No bootstrap required, opened a new log
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528524, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.188@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.118.189@KRBTEST.COM
I20260812 09:55:24.498248 5331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.498549 5331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0996bd0e6efb4c0393cd2f0957bfbe0b, State: Initialized, Role: FOLLOWER
I20260812 09:55:24.498948 5422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.489704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54220)
0812 09:55:24.489874 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.489890 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.489972 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.490283 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.490286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.490454 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.490516 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.490521 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.491465 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.491468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.492193 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.492200 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.492781 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.492785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.492875 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.493276 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.493290 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.495329 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.497339 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.497342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.497350 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.497579 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.497888 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.497892 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.497893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.497996 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.498375 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.498378 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.498466 (+ 88us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.498585 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.498763 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 09:55:24.499037 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.489954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.11.118.188:42177)
0812 09:55:24.490070 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.490076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.490091 (+ 15us) server_negotiation.cc:407] Connection header received
0812 09:55:24.490128 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.490131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.490170 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.490265 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.490627 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.491353 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.492299 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.492653 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.493306 (+ 653us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.495485 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.495494 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.495496 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.495519 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.497185 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.497674 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.497678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.497680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.497772 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.498076 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.498080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.498082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.498273 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.498382 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.498671 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.498852 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":43}
I20260812 09:55:24.498953 5331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.499605 5427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.499763 5427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.500409 5331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:24.500759 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.488306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33650 (local address 127.11.118.189:35557)
0812 09:55:24.488881 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.488885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.488896 (+ 11us) server_negotiation.cc:407] Connection header received
0812 09:55:24.488926 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.488929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.488969 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.489054 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.490139 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.490896 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.492044 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.492347 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.492471 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.495710 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.495714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.495717 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.495745 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.497487 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.497996 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.497999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.498001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.498090 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.498440 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.498443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.498445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.498669 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.498870 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.500412 (+ 1542us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.500553 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":141,"threads_started":1}
I20260812 09:55:24.502911 5418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: Bootstrap starting.
I20260812 09:55:24.506428 5418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:24.506583 11738 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 09:55:24.507056 5441 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:24.507164 5441 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:24.507469 5418 log.cc:824] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:24.504798 5253 master_runner.cc:186] Error getting master registration for 127.11.118.190:45219: OK, instance_id { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" instance_seqno: 1786528523956490 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 09:55:24.508550 5253 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 09:55:24.507959 5215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ea485fa2c77d489f8fcb491abac01c58"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45020
I20260812 09:55:24.509944 5418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: No bootstrap required, opened a new log
I20260812 09:55:24.513350 5418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.513607 5418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9eb20bcd5d4eaebdccc959556504c6, State: Initialized, Role: FOLLOWER
I20260812 09:55:24.514008 5418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.514588 5444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.514845 5444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.515988 5418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 09:55:24.524398 5456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:24.524526 5456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:24.521832 5339 master_runner.cc:186] Error getting master registration for 127.11.118.190:45219: OK, instance_id { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" instance_seqno: 1786528523956490 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 09:55:24.526090 5339 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 09:55:24.606546 5246 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } attempt: 4
Aug 12 09:55:24 dist-test-slave-2w3w krb5kdc[5156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786528523, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.118.190@KRBTEST.COM for kudu/127.11.118.188@KRBTEST.COM
I20260812 09:55:24.617445 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.607355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.11.118.188:42177)
0812 09:55:24.607825 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.607831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.607848 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:55:24.607895 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.607902 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.607950 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.608030 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.608543 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.609331 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.610469 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.610719 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.610843 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.613706 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.613710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.613713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.613804 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.615452 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.616051 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.616055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.616057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.616145 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.616460 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.616462 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.616464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.616682 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.616811 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.617143 (+ 332us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.617268 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382}
I20260812 09:55:24.617445 5250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.607281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.118.188:42177 (local address 127.0.0.1:54234)
0812 09:55:24.607521 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0812 09:55:24.607538 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 09:55:24.607656 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 09:55:24.608064 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 09:55:24.608067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 09:55:24.608299 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0812 09:55:24.608394 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.608400 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.609487 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.609490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.610349 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 09:55:24.610361 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.610864 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.610868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 09:55:24.610989 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.611641 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 09:55:24.611659 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 09:55:24.613527 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 09:55:24.615594 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.615599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.615603 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.615953 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.616258 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 09:55:24.616263 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 09:55:24.616265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 09:55:24.616364 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 09:55:24.616808 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 09:55:24.616811 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 09:55:24.616930 (+ 119us) client_negotiation.cc:769] Sending connection context
0812 09:55:24.617087 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 09:55:24.617271 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260812 09:55:24.621932 5246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: Bootstrap starting.
I20260812 09:55:24.625398 5246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: Neither blocks nor log segments found. Creating new log.
I20260812 09:55:24.626454 5246 log.cc:824] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: Log is configured to *not* fsync() on all Append() calls
I20260812 09:55:24.629590 5246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: No bootstrap required, opened a new log
I20260812 09:55:24.633172 5246 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.633471 5246 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea485fa2c77d489f8fcb491abac01c58, State: Initialized, Role: FOLLOWER
I20260812 09:55:24.633831 5246 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.634466 5460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.635000 5460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.635628 5246 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 09:55:24.635704 5215 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 09:55:24.635800 5215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:24.637382 5215 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.638513 5215 leader_election.cc:288] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [CANDIDATE]: Term 1 election: Requested vote from peers 0996bd0e6efb4c0393cd2f0957bfbe0b (127.11.118.189:35557), 7c9eb20bcd5d4eaebdccc959556504c6 (127.11.118.188:42177)
I20260812 09:55:24.639846 5298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea485fa2c77d489f8fcb491abac01c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b"
I20260812 09:55:24.640377 5298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:24.642244 5298 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea485fa2c77d489f8fcb491abac01c58 in term 1.
W20260812 09:55:24.642560 5473 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 09:55:24.642645 5473 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 09:55:24.642822 5384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ea485fa2c77d489f8fcb491abac01c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7c9eb20bcd5d4eaebdccc959556504c6"
I20260812 09:55:24.643189 5384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 09:55:24.644291 5384 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea485fa2c77d489f8fcb491abac01c58 in term 1.
I20260812 09:55:24.645154 5189 leader_election.cc:302] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9eb20bcd5d4eaebdccc959556504c6, ea485fa2c77d489f8fcb491abac01c58; no voters:
I20260812 09:55:24.651567 5460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 09:55:24.652143 5460 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [term 1 LEADER]: Becoming Leader. State: Replica: ea485fa2c77d489f8fcb491abac01c58, State: Running, Role: LEADER
I20260812 09:55:24.652715 5460 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } }
I20260812 09:55:24.653684 5170 master_runner.cc:263] No leader master found from master ea485fa2c77d489f8fcb491abac01c58
I20260812 09:55:24.653764 5170 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 09:55:24.655115 5460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea485fa2c77d489f8fcb491abac01c58. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.660127 5460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:24.669556 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.648832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.11.118.189:35557)
0812 09:55:24.648972 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.648978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.649631 (+ 653us) server_negotiation.cc:407] Connection header received
0812 09:55:24.650075 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.650078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.650131 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.650184 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.652833 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.653579 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.656969 (+ 3390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.657305 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.657408 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.662171 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.662176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.662179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.662219 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.664113 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.667412 (+ 3299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.667417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.667419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.667537 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.667892 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.667897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.667898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.668146 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.668289 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.669186 (+ 897us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.669349 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 09:55:24.670222 5489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 09:55:24.672560 5424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.647900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45022 (local address 127.11.118.190:45219)
0812 09:55:24.648066 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.648071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.649990 (+ 1919us) server_negotiation.cc:407] Connection header received
0812 09:55:24.651450 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.651454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.651515 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.651568 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.654796 (+ 3228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.655583 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.659638 (+ 4055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.660108 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.660213 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.664730 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.664735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.664738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.664771 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.666759 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.668659 (+ 1900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.668663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.668665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.668777 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.671338 (+ 2561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.671343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.671347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.671644 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.671790 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.672245 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.672411 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 09:55:24.675129 5489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 09:55:24.684631 5423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:24.649004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54238 (local address 127.11.118.188:42177)
0812 09:55:24.649120 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.649124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.660875 (+ 11751us) server_negotiation.cc:407] Connection header received
0812 09:55:24.662405 (+ 1530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.662412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.662488 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.662548 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.663638 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.664426 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.670427 (+ 6001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:24.670767 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:24.670862 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:24.676768 (+ 5906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 09:55:24.676774 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 09:55:24.676778 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 09:55:24.676822 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 09:55:24.679215 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.680286 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.680291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.680298 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.680432 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 09:55:24.681355 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 09:55:24.681359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 09:55:24.681361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 09:55:24.681664 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 09:55:24.681836 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:24.684259 (+ 2423us) server_negotiation.cc:299] Negotiation successful
0812 09:55:24.684445 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 09:55:24.691287 5384 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [term 1 FOLLOWER]: Refusing update from remote peer ea485fa2c77d489f8fcb491abac01c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:55:24.694947 5487 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 09:55:24.697559 5360 tablet.cc:2369] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:55:24.701406 5276 tablet.cc:2369] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 09:55:24.702140 5192 tablet.cc:2369] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 09:55:24.704666 5444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea485fa2c77d489f8fcb491abac01c58. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.704824 5444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.707041 5298 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [term 1 FOLLOWER]: Refusing update from remote peer ea485fa2c77d489f8fcb491abac01c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 09:55:24.707801 5487 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 09:55:24.712528 5427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea485fa2c77d489f8fcb491abac01c58. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.712694 5427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.721572 5487 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.721798 5487 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:24.723629 5427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.723809 5427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.727105 5490 mvcc.cc:205] Tried to move back new op lower bound from 7317620837125246976 to 7317620836982874112. Current Snapshot: MvccSnapshot[applied={T|T < 7317620837125246976}]
I20260812 09:55:24.729640 5493 mvcc.cc:205] Tried to move back new op lower bound from 7317620837125246976 to 7317620836982874112. Current Snapshot: MvccSnapshot[applied={T|T < 7317620837125246976}]
I20260812 09:55:24.735822 5460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.735999 5460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58 [sys.catalog]: This master's current role is: LEADER
I20260812 09:55:24.737447 5444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ea485fa2c77d489f8fcb491abac01c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea485fa2c77d489f8fcb491abac01c58" member_type: VOTER last_known_addr { host: "127.11.118.190" port: 45219 } } peers { permanent_uuid: "0996bd0e6efb4c0393cd2f0957bfbe0b" member_type: VOTER last_known_addr { host: "127.11.118.189" port: 35557 } } peers { permanent_uuid: "7c9eb20bcd5d4eaebdccc959556504c6" member_type: VOTER last_known_addr { host: "127.11.118.188" port: 42177 } } }
I20260812 09:55:24.737591 5444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 09:55:24.738469 5491 mvcc.cc:205] Tried to move back new op lower bound from 7317620837125246976 to 7317620836982874112. Current Snapshot: MvccSnapshot[applied={T|T < 7317620837125246976}]
I20260812 09:55:24.738811 5489 catalog_manager.cc:1347] Generated new cluster ID: a7a8339971a74df29b7233c07b7b4a74
I20260812 09:55:24.738876 5489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 09:55:24.754454 5489 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 09:55:24.756965 5489 catalog_manager.cc:1504] Loading token signing keys...
I20260812 09:55:24.770866 5489 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea485fa2c77d489f8fcb491abac01c58: Generated new TSK 0
I20260812 09:55:24.771910 5489 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 09:55:24.807865 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.806333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33660 (local address 127.11.118.189:35557)
0812 09:55:24.806448 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.806452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.806766 (+ 314us) server_negotiation.cc:407] Connection header received
0812 09:55:24.806990 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.806994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.807052 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.807110 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.807715 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33660: BlockingRecv error: recv got EOF from 127.0.0.1:33660 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260812 09:55:24.808073 5423 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.806514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54244 (local address 127.11.118.188:42177)
0812 09:55:24.806652 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.806656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.807202 (+ 546us) server_negotiation.cc:407] Connection header received
0812 09:55:24.807438 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.807441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.807490 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.807589 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.807945 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54244: BlockingRecv error: recv got EOF from 127.0.0.1:54244 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260812 09:55:24.808073 5424 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.806082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45038 (local address 127.11.118.190:45219)
0812 09:55:24.806218 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.806223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.806482 (+ 259us) server_negotiation.cc:407] Connection header received
0812 09:55:24.806661 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.806667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.806728 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.806790 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.807947 (+ 1157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45038: BlockingRecv error: recv got EOF from 127.0.0.1:45038 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260812 09:55:24.812129 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.810700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33674 (local address 127.11.118.189:35557)
0812 09:55:24.810848 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.810856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.811040 (+ 184us) server_negotiation.cc:407] Connection header received
0812 09:55:24.811280 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.811285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.811381 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.811477 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.812001 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33674: BlockingRecv error: recv got EOF from 127.0.0.1:33674 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 09:55:24.818148 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.816871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.11.118.189:35557)
0812 09:55:24.817046 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.817053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.817072 (+ 19us) server_negotiation.cc:407] Connection header received
0812 09:55:24.817138 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.817142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.817196 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.817290 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.818001 (+ 711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33684: BlockingRecv error: recv got EOF from 127.0.0.1:33684 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 09:55:24.824007 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.822738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33692 (local address 127.11.118.189:35557)
0812 09:55:24.822895 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.822900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.823032 (+ 132us) server_negotiation.cc:407] Connection header received
0812 09:55:24.823201 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.823205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.823267 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.823375 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.823875 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33692: BlockingRecv error: recv got EOF from 127.0.0.1:33692 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 09:55:24.832188 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.830455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33702 (local address 127.11.118.189:35557)
0812 09:55:24.830659 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.830664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.831156 (+ 492us) server_negotiation.cc:407] Connection header received
0812 09:55:24.831247 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.831250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.831317 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.831422 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.832056 (+ 634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33702: BlockingRecv error: recv got EOF from 127.0.0.1:33702 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
W20260812 09:55:24.845378 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.843401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33712 (local address 127.11.118.189:35557)
0812 09:55:24.843557 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.843562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.843877 (+ 315us) server_negotiation.cc:407] Connection header received
0812 09:55:24.844196 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.844200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.844307 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.844417 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.845126 (+ 709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33712: BlockingRecv error: recv got EOF from 127.0.0.1:33712 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 09:55:24.865947 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.864609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.11.118.189:35557)
0812 09:55:24.864764 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.864769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.864906 (+ 137us) server_negotiation.cc:407] Connection header received
0812 09:55:24.865073 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.865078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.865144 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.865255 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.865805 (+ 550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33726: BlockingRecv error: recv got EOF from 127.0.0.1:33726 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 09:55:24.902086 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.900730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33728 (local address 127.11.118.189:35557)
0812 09:55:24.900897 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.900903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.901049 (+ 146us) server_negotiation.cc:407] Connection header received
0812 09:55:24.901277 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.901281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.901396 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.901489 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.901955 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33728: BlockingRecv error: recv got EOF from 127.0.0.1:33728 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260812 09:55:24.969805 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:24.968473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33744 (local address 127.11.118.189:35557)
0812 09:55:24.968636 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:24.968641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:24.968777 (+ 136us) server_negotiation.cc:407] Connection header received
0812 09:55:24.969009 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:24.969013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:24.969075 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:24.969174 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:24.969685 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33744: BlockingRecv error: recv got EOF from 127.0.0.1:33744 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 09:55:25.101573 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:25.100223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33750 (local address 127.11.118.189:35557)
0812 09:55:25.100379 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.100384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.100516 (+ 132us) server_negotiation.cc:407] Connection header received
0812 09:55:25.100638 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.100641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.100704 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.100799 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:25.101451 (+ 652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33750: BlockingRecv error: recv got EOF from 127.0.0.1:33750 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260812 09:55:25.361562 5330 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 09:55:25.360197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33758 (local address 127.11.118.189:35557)
0812 09:55:25.360390 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.360398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.360509 (+ 111us) server_negotiation.cc:407] Connection header received
0812 09:55:25.360709 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.360712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.360765 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.360863 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 09:55:25.361410 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33758: BlockingRecv error: recv got EOF from 127.0.0.1:33758 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 09:55:25.508592 5441 catalog_manager.cc:1259] Loaded cluster ID: a7a8339971a74df29b7233c07b7b4a74
I20260812 09:55:25.508744 5441 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: loading cluster ID for follower catalog manager: success
I20260812 09:55:25.510634 5441 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: acquiring CA information for follower catalog manager: success
I20260812 09:55:25.511976 5441 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0996bd0e6efb4c0393cd2f0957bfbe0b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:55:25.525965 5456 catalog_manager.cc:1259] Loaded cluster ID: a7a8339971a74df29b7233c07b7b4a74
I20260812 09:55:25.526064 5456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: loading cluster ID for follower catalog manager: success
I20260812 09:55:25.528121 5456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: acquiring CA information for follower catalog manager: success
I20260812 09:55:25.529641 5456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7c9eb20bcd5d4eaebdccc959556504c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 09:55:25.881639 5576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:25.876116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33774 (local address 127.11.118.189:35557)
0812 09:55:25.876384 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.876388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.876606 (+ 218us) server_negotiation.cc:407] Connection header received
0812 09:55:25.876702 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.876705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.876916 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.877028 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:25.877343 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.877991 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.879026 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.879276 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.879380 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:25.880126 (+ 746us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:25.880679 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:25.881268 (+ 589us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:25.881407 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 09:55:25.881497 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":139,"threads_started":1}
I20260812 09:55:25.889297 5582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:25.885344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.11.118.188:42177)
0812 09:55:25.885606 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.885610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.885623 (+ 13us) server_negotiation.cc:407] Connection header received
0812 09:55:25.885710 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.885713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.885836 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.885944 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:25.886206 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.886762 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.887766 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.888006 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.888096 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:25.888439 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:25.888883 (+ 444us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:25.889023 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:25.889104 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 09:55:25.889163 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":120,"threads_started":1}
I20260812 09:55:25.898067 5576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:25.893119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33786 (local address 127.11.118.189:35557)
0812 09:55:25.893263 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.893267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.893442 (+ 175us) server_negotiation.cc:407] Connection header received
0812 09:55:25.894360 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.894364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.894427 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.894477 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:25.894904 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.895613 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.896588 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.896940 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.897060 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:25.897540 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:25.897623 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:25.897709 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:25.897854 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 09:55:25.897917 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 09:55:25.898067 5582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:25.893687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.11.118.188:42177)
0812 09:55:25.893852 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.893866 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.893882 (+ 16us) server_negotiation.cc:407] Connection header received
0812 09:55:25.894132 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.894135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.894195 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.894280 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:25.894543 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.895286 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.896667 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.896996 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.897091 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:25.897517 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:25.897605 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:25.897682 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:25.897838 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 09:55:25.897913 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 09:55:25.898396 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 09:55:25.893026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45044 (local address 127.11.118.190:45219)
0812 09:55:25.893645 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0812 09:55:25.893650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 09:55:25.893667 (+ 17us) server_negotiation.cc:407] Connection header received
0812 09:55:25.893775 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 09:55:25.893780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 09:55:25.893933 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 09:55:25.894074 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 09:55:25.894327 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.895146 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.896636 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 09:55:25.896887 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 09:55:25.897012 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 09:55:25.897355 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 09:55:25.897755 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 09:55:25.897861 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 09:55:25.898160 (+ 299us) server_negotiation.cc:299] Negotiation successful
0812 09:55:25.898229 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":67,"threads_started":1}
I20260812 09:55:25.902336 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 5170
I20260812 09:55:25.912160 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 5253
I20260812 09:55:25.921671 11738 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskilB4wR/build/debug/bin/kudu with pid 5339
2026-08-12T09:55:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3484 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6890 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (309698 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST